-- Logs begin at Thu 2022-09-01 15:48:31 UTC, end at Thu 2022-09-01 16:52:04 UTC. -- Sep 01 16:25:27.110883 dv-cinder-852209-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 16:25:27.120086 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 16:25:27.122049 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 16:25:27 2022] *** Sep 01 16:25:27.122049 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 16:25:27.122049 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 16:25:27.122049 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: nodename: dv-cinder-852209-10-iscsi Sep 01 16:25:27.122049 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: machine: x86_64 Sep 01 16:25:27.122049 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: clock source: unix Sep 01 16:25:27.122049 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: pcre jit disabled Sep 01 16:25:27.122049 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: detected number of CPU cores: 4 Sep 01 16:25:27.122049 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: current working directory: / Sep 01 16:25:27.122049 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: detected binary path: /usr/bin/uwsgi-core Sep 01 16:25:27.122733 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: your processes number limit is 47680 Sep 01 16:25:27.122733 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: your memory page size is 4096 bytes Sep 01 16:25:27.122733 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: detected max file descriptor number: 2048 Sep 01 16:25:27.122733 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: lock engine: pthread robust mutexes Sep 01 16:25:27.122733 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: thunder lock: enabled Sep 01 16:25:27.122733 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 16:25:27.122733 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 16:25:27.161342 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: Python main interpreter initialized at 0x5609a591b9c0 Sep 01 16:25:27.161342 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: python threads support enabled Sep 01 16:25:27.161342 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: your server socket listen backlog is limited to 100 connections Sep 01 16:25:27.161342 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: your mercy for graceful operations on workers is 90 seconds Sep 01 16:25:27.161699 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 16:25:27.161776 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: *** Operational MODE: preforking *** Sep 01 16:25:27.161978 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: *** uWSGI is running in multiple interpreter mode *** Sep 01 16:25:27.161978 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: spawned uWSGI master process (pid: 105706) Sep 01 16:25:27.162153 dv-cinder-852209-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 16:25:27.162868 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: spawned uWSGI worker 1 (pid: 105707, cores: 1) Sep 01 16:25:27.163059 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: spawned uWSGI worker 2 (pid: 105708, cores: 1) Sep 01 16:25:27.163213 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 16:25:27.813213 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 16:25:27.815478 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 16:25:28.896079 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:25:28.896079 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: from cryptography.utils import int_from_bytes Sep 01 16:25:28.896692 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:25:28.896692 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: from cryptography.utils import int_from_bytes Sep 01 16:25:28.897070 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:25:28.897070 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: from cryptography.utils import int_from_bytes Sep 01 16:25:28.897183 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:25:28.897183 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: from cryptography.utils import int_from_bytes Sep 01 16:25:31.358745 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:25:31.359309 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:25:31.359555 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:25:31.359915 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:25:31.360167 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:25:31.360354 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:25:31.360718 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.360800 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:25:31.360865 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.361137 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:25:31.361252 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.361462 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.361811 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:25:31.361994 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:25:31.362093 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.362367 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.362512 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.365030 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.365139 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.365209 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.365273 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.365335 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.365398 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.365551 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.365630 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.365701 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.365766 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.365828 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-10-iscsi {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.365900 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.365965 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.366037 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.366108 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.366173 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.366271 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.366357 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.366432 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.366512 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.366584 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.366649 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-10-iscsi {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.366721 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.366787 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.366858 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.367393 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.367393 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.367521 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.367610 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.367677 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.367739 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.367812 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.367893 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.367980 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.368046 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.368120 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.368344 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.368473 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.369394 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.369532 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.369614 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.369680 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.369761 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.369835 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.369835 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.369963 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.370036 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.370103 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.370187 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.370278 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-10-iscsi {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.370522 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.370615 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.370809 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.370916 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.371131 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.371220 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.371438 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.371524 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.371832 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.371918 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-10-iscsi {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.372141 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.372245 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.372449 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.372544 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.372764 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.372850 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.373070 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.373164 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.373394 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.373477 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.373712 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.373807 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.374028 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.374128 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.374375 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.374483 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.374680 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.374789 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.374982 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.375567 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.375817 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.375907 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.376133 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.376220 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.376436 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.376524 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.376736 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.376829 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.376988 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.377085 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.377292 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.377379 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.377614 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.377700 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.377931 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.378027 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.378272 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.378367 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.378520 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.378609 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.378770 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.378869 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.379086 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.379182 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.379405 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.379502 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.379711 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.379811 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.379995 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.380082 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.380248 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.380336 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.380567 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.380659 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.380888 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.380976 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.381188 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.381286 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.381490 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.381576 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.381792 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.381886 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.382096 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.382194 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.382426 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.382574 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.382734 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.382822 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.383038 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.383132 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.383341 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.383426 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.383661 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.383755 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.383972 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.384066 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.384276 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.384370 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.384587 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.384672 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.384915 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.385015 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.385218 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.385315 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.385533 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.385619 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.385844 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.385946 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.386145 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.386231 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.386475 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.386565 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.386778 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.386882 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.387095 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.387182 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.387423 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.387508 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.387725 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.387818 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.387974 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.388061 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.388272 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.388367 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.388574 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.388662 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.388890 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.388984 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.389192 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.389360 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.389478 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.389564 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.389779 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.389913 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.390076 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.390171 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.390412 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.390502 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.390821 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.391428 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.391782 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.391883 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.392125 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.392219 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.392451 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.392553 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.392777 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.392872 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.393102 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.393189 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.393425 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.393511 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.393743 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.393829 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.394060 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.394154 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.394400 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.394501 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.394716 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.394804 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.395030 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.395120 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.395348 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.395442 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.395663 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.395763 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.395980 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.396076 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.396305 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.396398 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.396617 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.396714 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.396928 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.397023 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.397239 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.397325 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.397549 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.397797 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.397886 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.397964 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.398171 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.398277 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.398506 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.398603 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.398826 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.398924 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.399138 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.399223 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.399449 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.399549 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.399761 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.399848 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.400070 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.400159 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.400377 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.400465 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.400692 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.400790 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.401001 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.401100 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.401313 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.401399 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.401627 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.401714 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.401932 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.402026 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.402291 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.402382 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.402569 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.402654 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.402895 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.403002 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.403176 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.403261 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.403484 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.403570 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.403789 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.403891 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.404095 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.404181 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.404396 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.404482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.404714 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.404844 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.405036 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.405130 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.405346 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.405431 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.405655 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.405742 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.405962 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.406129 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.406309 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:25:31.406400 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.406650 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.406745 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.406986 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.407074 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.407341 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.407445 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.407647 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.407741 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.407984 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.408079 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.408305 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.408400 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.408626 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.408712 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.408940 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.409032 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.409255 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.409354 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.409578 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.409666 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.409893 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.409987 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.410212 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.410344 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.410552 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.410647 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.410871 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.410958 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.411192 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.411355 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.411519 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.411606 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.411837 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.411922 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.412158 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.412257 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.412474 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.412560 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.412786 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.412881 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.413105 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.413210 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.413435 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.413523 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.413756 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.413855 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.414069 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.414159 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.414428 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.414516 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.414751 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.414839 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.415070 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.415158 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.415395 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.415489 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.415717 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.415811 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.416030 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.416124 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.416344 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.416431 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.416656 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.416750 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.416981 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.417068 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.417296 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.417382 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.417612 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.417765 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.417924 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.418024 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.418245 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.418341 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.418577 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.418679 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.418892 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.418987 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.419206 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.419292 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.419522 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.419686 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.419827 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.419966 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.420130 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.420265 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.420467 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.420565 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.420782 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.420870 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.421107 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.421192 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.421419 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.421513 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.421727 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.421813 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.422037 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.422132 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.422370 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.422460 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.422681 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.422768 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.422990 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.423121 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.423291 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.423378 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.423595 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.423683 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.423899 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.423985 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.424210 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.424297 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.424513 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.424607 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.424830 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.424917 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.425157 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.425287 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.425459 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.425544 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.425772 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.425873 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.426080 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.426174 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.426414 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.426503 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.426723 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.426819 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.427030 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.427116 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.427335 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.427421 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.427644 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.427743 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.427954 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.428042 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.428258 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.428345 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.428566 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.428665 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.428877 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.428964 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.429182 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.429277 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.429493 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.429581 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.429795 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.429882 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.430099 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.430187 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.430435 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.430527 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.430746 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.430834 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.431061 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.431149 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.431371 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.431460 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.431682 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.431769 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.432004 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.432106 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.432315 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.432411 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.432623 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.432710 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.432952 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.433046 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.433263 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.433360 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.433568 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.433662 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.433873 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.433967 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.434182 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.434302 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.434516 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.434604 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.434818 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.434924 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.435124 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.435211 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.435424 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.435519 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.435726 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.435823 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.436028 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.436115 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.436333 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.436426 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.436633 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.436726 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.436934 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.437021 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.437235 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.437334 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.437536 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.438123 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.438360 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.438458 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.438681 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.438768 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.438990 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.439079 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.439293 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.439387 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.439596 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.439692 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.439897 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.439993 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.440241 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.440376 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.440545 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.440713 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.440894 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.440989 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.441211 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.441346 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.441527 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.441629 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.441842 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.441928 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.442149 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.442254 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.442490 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.442596 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.442802 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.442889 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.443113 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.443202 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.443423 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.443528 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.443731 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.443820 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.444047 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.444132 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.444354 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.444440 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.444666 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.444753 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.444975 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.445061 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.445300 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.445388 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.445611 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.445709 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.445929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.446015 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.446275 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.446367 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.446568 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.446654 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.446895 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.446980 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.447213 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.447303 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.447529 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.447618 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.447843 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.447940 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.448152 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.448237 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.448468 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.448555 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.448777 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.448874 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.449088 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.449186 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.449395 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.449490 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.449702 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.449799 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.450018 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.450106 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.450349 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.450439 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.450661 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.450768 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.450976 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.451071 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.451297 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.451386 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.451605 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.451703 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.451921 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.452016 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.452223 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.452311 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.452537 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.452626 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.452850 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.452936 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.453168 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.453836 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.454024 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.454114 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.454355 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.454443 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.454671 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.454767 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.454978 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.455064 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.455288 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.455375 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.455602 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.455696 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.455907 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.455995 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.456213 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.456301 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.456524 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.456622 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.456836 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.456922 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.457142 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.457236 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.457450 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.457551 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.457752 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.457846 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.458067 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.458154 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.458396 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.458499 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.458700 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.458787 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.459001 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.459091 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.459309 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.459406 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.459628 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.459719 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.459937 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.460025 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.460257 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.460345 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.460564 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.460695 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.460870 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.460956 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.461175 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.461285 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.461488 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.461581 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.461795 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.461882 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.462099 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.462187 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.462426 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.462515 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.462731 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.462827 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.463065 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.463159 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.463372 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.463458 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.463673 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.463768 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.463986 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.464072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.464305 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.464390 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.464616 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.464716 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.464928 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.465014 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.465235 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.465320 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.465544 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.465640 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.465853 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.465947 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.466161 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.466265 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.466493 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.466638 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.466800 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.466887 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.467107 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.467194 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.467415 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.467511 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.467723 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.467809 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.468038 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.468124 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.468344 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.468470 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.468651 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.468957 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.469083 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.469278 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.469374 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.469585 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.469672 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.469901 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.469988 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.470289 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.470495 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.470600 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.470835 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.470932 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.471150 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.471250 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.471470 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.471567 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.471814 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.471911 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.472133 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.472221 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.472460 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.472547 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.472773 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.472862 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.473084 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.473169 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.473389 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.473487 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.473699 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.473785 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.474002 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.474136 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.474342 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.474452 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.474654 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.474741 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.474954 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.475047 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.475260 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.475355 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.475564 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.475651 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.475875 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.475971 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.476175 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.476277 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.476482 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.476578 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.476788 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.476875 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.477090 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.477190 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.477404 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.477491 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.477707 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.477793 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.478014 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.478113 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.478339 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.478443 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.478661 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.478749 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.478969 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.479058 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.479271 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.479367 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.479572 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.479659 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.479871 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.479960 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.480210 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.480297 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.480512 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.480600 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.480853 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.480941 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.481177 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.481263 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.481490 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.481586 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.481798 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.481886 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.482099 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.482193 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.482446 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.482552 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.482752 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.482847 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.483056 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.483143 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.483357 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.483454 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.483665 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.483753 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.483972 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.484060 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.484274 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.484379 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.485095 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.485186 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.485403 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.485489 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.485709 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.485804 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.486015 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.486119 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.486336 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.486429 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.486910 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.487005 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.487210 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.487296 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.487522 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.487611 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.487828 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.487921 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.488127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.488220 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.488431 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.488525 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.488742 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.488831 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.489048 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.489133 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.489348 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.489441 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.489654 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.489740 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.489952 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.490037 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.490282 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.490389 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.490590 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.490685 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.490892 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.491027 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.491194 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.491291 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.491510 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.491605 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.491818 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.491904 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.492117 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.492211 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.492430 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.492524 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.492737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.492829 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.493041 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.493129 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.493343 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.493431 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.493653 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.493740 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.493956 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.494045 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.494286 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.494378 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.494585 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.494673 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.494891 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.494980 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.495199 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.495286 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.495501 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.495595 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.495806 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.495900 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.496106 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.496196 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.496409 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.496503 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.496709 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.496795 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.497013 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.497099 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.497314 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.497410 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.497616 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.497703 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.497918 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.498006 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.498221 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.498338 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.498544 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.498632 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.498864 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.498951 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.499176 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.499272 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.499484 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.499571 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.499793 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.499880 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.500180 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.500814 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.501071 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.501179 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.501388 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.501476 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.501710 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.501799 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.502030 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.502117 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.502364 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.502456 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.502689 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.502779 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.503004 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.503099 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.503323 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.503410 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.503632 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.503719 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.503937 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.504022 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.504254 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.504350 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.504564 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.504653 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.504875 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.504976 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.505178 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.505273 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.505482 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.505570 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.505801 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.505888 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.506113 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.506210 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.506447 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.506536 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.506760 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.506849 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.507075 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.507179 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.507408 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.507498 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.507692 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.507777 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.508001 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.508097 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.508310 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.508398 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.508619 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.508706 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.508928 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.509016 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.509238 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.509323 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.509544 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.509642 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.509856 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.509944 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.510165 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.510279 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.510498 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.510584 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.510804 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.510930 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.511162 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.511263 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.511421 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.511508 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.511729 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.511826 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.512034 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.512127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.512345 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.512447 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.512653 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.512739 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.512954 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.513084 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.513261 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.513402 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.513562 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.513716 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.513869 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.514027 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.514173 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.514365 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.514624 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.514711 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.514935 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.515025 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.515244 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.515340 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.515547 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.515635 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.515882 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.516021 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.516192 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.516340 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.516504 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.516655 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.516815 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.516970 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.517119 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.517280 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.517533 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.517629 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.517842 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.517929 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.518149 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.518256 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.518505 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.518666 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.518806 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.518894 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.519109 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.519206 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.519416 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.519504 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.519727 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.519822 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.520027 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.520113 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.520329 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.520460 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.520629 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.520778 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.520952 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.521088 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.521270 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.521512 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.521601 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.521830 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.521964 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.522145 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.522293 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.522499 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.522587 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.522826 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.522997 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.523155 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.523307 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.523465 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.523617 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.523783 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.523936 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.524099 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.524256 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.524428 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.524576 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.524755 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.524880 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.525070 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.525191 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.525391 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.525500 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.525699 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.525821 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.526028 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.526142 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.526382 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.526473 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.526703 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.526804 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.527031 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.527118 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.527365 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.527452 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.527684 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.527786 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.527994 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.528088 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.528313 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.528401 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.528695 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.528791 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.529008 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.529103 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.529317 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.529404 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.529633 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.529722 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.529940 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.530043 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.530313 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.530405 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.530571 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.530661 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.530883 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.530969 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.531187 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.531285 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.531521 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.531613 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.531836 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.531923 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.532138 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.532238 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.532447 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.532534 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.532753 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.532848 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.533062 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.533158 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.533365 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.533454 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.533667 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.533754 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.533986 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.534083 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.534312 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.534406 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.534635 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.534763 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.534947 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.535081 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.535262 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.535348 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.535571 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.535666 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.535871 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.535959 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.536176 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.536263 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.536489 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.536576 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.536793 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.536882 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.537095 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.537183 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.537396 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.537495 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.537735 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.537825 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.538039 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.538134 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.538383 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.538497 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.538712 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.538809 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.539041 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.539129 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.539349 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.539450 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.539677 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.539765 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.540001 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.540098 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.540319 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.540438 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.540630 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.540855 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.540944 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.541234 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.541413 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.541554 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.541845 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.541975 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.542153 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.542486 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.542575 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.542797 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.543123 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.543210 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.543433 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.543663 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.543762 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.544064 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.544241 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.544372 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.544682 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.544820 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.544989 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.545335 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.545422 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.545643 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.545917 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.546005 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.546303 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.546491 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.546691 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.546841 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.547537 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.547708 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.547860 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.548031 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.548180 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.548369 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.548501 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.548694 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.548820 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.549010 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.549138 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.549324 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.549458 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.549637 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.549772 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.549987 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.550083 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.550324 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.550414 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.550659 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.550749 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.550976 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.551260 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.551403 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.551629 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.551804 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.551924 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.552011 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.552244 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.552342 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.552561 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.552651 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.552876 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.552964 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.553189 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.553297 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.553505 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.553607 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.553815 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.553903 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.554127 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.554217 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.554463 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.554552 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.554784 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.554873 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.555107 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.555307 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.555440 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.555640 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.555784 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.555959 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.556106 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.556275 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.556426 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.556591 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.556742 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.556905 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.557060 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.557217 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.557421 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.557520 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.557740 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.557827 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.558051 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.558148 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.558394 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.558485 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.558715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.558812 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.559034 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.559123 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.559349 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.559438 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.559665 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.559761 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.559983 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.560072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.560300 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.560387 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.560616 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.560716 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.560927 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.561022 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.561242 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.561375 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.561561 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.562109 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.562109 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.562368 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.562461 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.562544 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.563232 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.563321 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.563410 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.563491 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.563662 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.563758 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.563972 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.564069 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.564288 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.564551 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.564639 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.564872 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.564968 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.565195 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.565286 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.565508 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.565604 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.565820 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.565910 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.566145 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.566270 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.566491 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.566592 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.566814 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.566912 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.567125 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.567211 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.567435 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.567529 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.567748 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.567835 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.568064 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.568261 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.568377 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.568578 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.568708 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.568910 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.569024 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.569236 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.569332 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.569559 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.569661 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.569871 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.569960 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.570186 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.570505 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.570607 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.570825 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.570922 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.571130 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.571217 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.571440 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.571584 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.571754 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.571898 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.572059 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.572150 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.572381 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.572471 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.572694 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.572781 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.572999 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.573094 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.573319 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.573415 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.573628 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.573716 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.573940 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.574157 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.574310 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.574523 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.574621 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.574836 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.574925 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.575163 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.575264 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.575473 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.575560 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.575789 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.575880 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.576093 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.576182 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.576416 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.576503 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.576724 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.576813 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.577028 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.577117 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.577335 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.577421 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.577644 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.577730 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.577949 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.578038 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.578295 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.578389 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.578605 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.578692 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.578914 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.579005 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.579217 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.579304 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.579524 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.579623 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.579825 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.579913 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.580135 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.580221 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.580443 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.580539 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.580749 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.580837 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.581053 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.581149 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.581361 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.581571 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.581711 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.581796 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.581966 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.582100 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.582301 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.582405 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.582608 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.582704 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.582917 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.583005 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.583219 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.583308 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.583527 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.583615 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.583831 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.583928 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.584139 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.584237 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.584442 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.584530 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.584798 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.585027 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.585123 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.585365 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.585453 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.585690 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.585777 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.585990 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.586086 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.586329 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.586422 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.586641 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.586740 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.586962 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.587052 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.587271 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.587358 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.587575 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.587661 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.587901 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.587989 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.588216 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.588313 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.588534 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.588748 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.588848 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.589081 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.589169 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.589401 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.589489 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.589732 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.589829 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.590049 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.590136 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.590380 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.590482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.590689 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.590778 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.590994 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.591082 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.591306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.591393 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.591615 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.591710 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.591927 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.592032 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.592235 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.592333 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.592546 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.592636 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.592856 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.592944 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.593165 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.593267 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.593474 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.593572 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.593782 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.593892 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.594114 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.594211 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.594447 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.594548 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.594758 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.594846 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.595067 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.595165 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.595376 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.595464 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.595685 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.595774 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.595996 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.596086 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.596309 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.596404 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.596638 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.596725 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.596955 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.597044 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.597271 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.597359 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.597587 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.597682 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.597898 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.597987 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.598209 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.598373 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.598543 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.598640 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.598852 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.598942 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.599165 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.599262 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.599492 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.599595 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.599805 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.599894 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.600109 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.600205 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.600509 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.600605 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.600820 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.600911 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.601136 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.601222 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.601446 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.601544 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.601756 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.601879 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.602076 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.602165 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.602419 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.602518 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.602727 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.602826 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.603033 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.603120 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.603341 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.603437 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.603655 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.603750 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.603962 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.604051 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.604271 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.604360 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.604577 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.604665 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.604884 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.605042 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.605189 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.605286 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.605492 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.605580 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.605796 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.605892 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.606103 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.606192 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.606433 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.606520 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.606736 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.606836 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.607037 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.607125 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.607345 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.607433 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.607646 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.607743 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.607949 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.608044 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.608250 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.608338 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.608551 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.608641 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.608898 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.608998 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.609152 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.609239 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.609968 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.610066 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.610297 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.610392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.610603 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.610693 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.610903 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.610994 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.611204 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.611292 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.611509 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.611862 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.612072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.612169 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.612382 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.612513 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.612686 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.612797 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.612986 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.613094 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.613285 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.613428 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.613610 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.613744 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.613939 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.614058 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.614268 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.614398 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.614594 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.614702 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.614902 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.615015 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.615222 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.615330 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.615532 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.615668 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.615850 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.615977 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.616167 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.616287 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.616478 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.616620 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.616787 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.616942 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.617118 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.617267 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.617428 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.617588 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.617734 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.617905 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.618042 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.618256 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.618361 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.618574 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.618663 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.618890 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.618977 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.619205 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.619294 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.619519 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.619668 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.619842 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.619939 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.620153 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.620243 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.620468 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.620555 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.620781 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.620870 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.621094 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.621183 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.621403 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.621492 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.621731 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.621833 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.622041 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.622147 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.622374 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.622526 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.622683 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.622786 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.622991 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.623078 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.623298 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.623387 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.623611 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.623708 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.623920 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.624009 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.624229 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.624324 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.624544 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.624633 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.624856 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.624943 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.625717 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.625825 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.626046 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.626136 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:25:31.626378 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.626706 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.627030 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.627374 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.627685 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.628026 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.628353 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.628665 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.628974 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.629278 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:25:31.629521 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:25:31.777753 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO dbcounter [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] Registered counter for database nova_api Sep 01 16:25:31.781348 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO dbcounter [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] Registered counter for database nova_api Sep 01 16:25:31.799916 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG oslo_db.sqlalchemy.engines [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:25:31.801660 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_db.sqlalchemy.engines [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:25:31.806509 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writer thread running {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:25:31.808405 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writer thread running {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:25:31.862345 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.context [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9109a614-d982-4086-8e90-ca50e4acd6aa(cell1) {{(pid=105708) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 16:25:31.864548 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.context [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9109a614-d982-4086-8e90-ca50e4acd6aa(cell1) {{(pid=105707) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 16:25:31.866094 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:25:31.866592 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:25:31.868137 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:25:31.868418 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:25:31.868840 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:25:31.868928 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:25:31.869280 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:25:31.870483 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:25:31.871280 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:25:31.871496 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:25:31.871981 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:25:31.873217 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO dbcounter [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] Registered counter for database nova_cell0 Sep 01 16:25:31.873970 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:25:31.876572 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO dbcounter [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] Registered counter for database nova_cell0 Sep 01 16:25:31.877717 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO dbcounter [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] Registered counter for database nova_cell1 Sep 01 16:25:31.880554 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO dbcounter [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] Registered counter for database nova_cell1 Sep 01 16:25:31.885465 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG oslo_db.sqlalchemy.engines [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:25:31.886317 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG oslo_db.sqlalchemy.engines [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:25:31.890225 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_db.sqlalchemy.engines [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:25:31.891754 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_db.sqlalchemy.engines [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:25:31.893289 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writer thread running {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:25:31.893626 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writer thread running {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:25:31.896234 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writer thread running {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:25:32.036303 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO dbcounter [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] Registered counter for database nova_cell0 Sep 01 16:25:32.036870 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writer thread running {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:25:32.044857 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG oslo_db.sqlalchemy.engines [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:25:32.045723 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO dbcounter [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] Registered counter for database nova_cell0 Sep 01 16:25:32.050462 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writer thread running {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:25:32.054992 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_db.sqlalchemy.engines [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:25:32.059648 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writer thread running {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:25:32.384470 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: WARNING keystonemiddleware.auth_token [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:25:32.386790 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: WARNING keystonemiddleware.auth_token [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:25:32.392271 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: WARNING keystonemiddleware.auth_token [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:25:32.394535 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: WARNING keystonemiddleware.auth_token [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:25:32.732581 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: WARNING keystonemiddleware.auth_token [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:25:32.734832 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: WARNING keystonemiddleware.auth_token [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:25:32.738761 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: WARNING keystonemiddleware.auth_token [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:25:32.741031 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: WARNING keystonemiddleware.auth_token [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:25:32.743995 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5609a591b9c0 pid: 105708 (default app) Sep 01 16:25:32.746036 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:32.746258 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5609a591b9c0 pid: 105707 (default app) Sep 01 16:25:32.747259 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-2641e6d8-22f7-4a0c-ac88-00e114c3bd69 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001725 Sep 01 16:25:32.747656 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Thu Sep 1 16:25:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:26:49.800415 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:49.801752 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 Sep 01 16:26:49.802196 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 1 16:26:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:26:49.813953 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_api:SELECT=3 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:49.815092 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_cell1:SELECT=3 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:49.816072 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_cell0:SELECT=3 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:49.817095 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:50.732430 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-b6eca1c3-72d4-4daf-bf93-2376c6a69672 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:50.767626 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-b6eca1c3-72d4-4daf-bf93-2376c6a69672 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.959379 Sep 01 16:26:50.768361 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1292 bytes} [Thu Sep 1 16:26:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:53.133222 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:53.134031 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-708ee04e-5ab3-4f74-9ca7-88af6959ac4a None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Sep 01 16:26:53.134918 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 2/4] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 1 16:26:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:26:53.577455 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-613bca96-0d08-42ab-93a6-28c77dd18195 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "ram": 256, "id": "c1", "vcpus": 1, "disk": 1}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:26:53.630099 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-613bca96-0d08-42ab-93a6-28c77dd18195 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.489147 Sep 01 16:26:53.633884 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 3/5] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 1 16:26:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:26:53.873099 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-e3975329-d679-4997-9e73-15926b8c9fbc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:26:53.879435 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_api:SELECT=3 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:53.880290 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_cell1:SELECT=3 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:53.881217 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_cell0:SELECT=3 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:53.881948 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:53.942575 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-e3975329-d679-4997-9e73-15926b8c9fbc admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.302958 Sep 01 16:26:53.943337 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 3/6] 10.222.0.18 () {64 vars in 1336 bytes} [Thu Sep 1 16:26:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:56.296134 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-613bca96-0d08-42ab-93a6-28c77dd18195 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:56.297404 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-613bca96-0d08-42ab-93a6-28c77dd18195 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001707 Sep 01 16:26:56.298074 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 4/7] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 1 16:26:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:26:56.976510 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-3583a61d-a0d9-449b-bc4d-411717ff34ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M", "swap": 0, "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5, "ram": 512}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:26:57.016662 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-3583a61d-a0d9-449b-bc4d-411717ff34ca admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.712232 Sep 01 16:26:57.017465 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 4/8] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 1 16:26:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:26:57.029943 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-07375435-f68a-4bc6-b207-8e9577afc2b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:26:57.064797 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-07375435-f68a-4bc6-b207-8e9577afc2b6 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039111 Sep 01 16:26:57.065562 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 5/9] 10.222.0.18 () {64 vars in 1336 bytes} [Thu Sep 1 16:26:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:26:59.440310 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-3583a61d-a0d9-449b-bc4d-411717ff34ca admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:59.441324 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-3583a61d-a0d9-449b-bc4d-411717ff34ca admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 01 16:26:59.441723 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 1 16:26:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:26:59.834506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-f12f5aff-2056-4442-8abd-99e4df19329e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "swap": 0}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:26:59.852937 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-f12f5aff-2056-4442-8abd-99e4df19329e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.405051 Sep 01 16:26:59.853476 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 6/11] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 1 16:26:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:26:59.865595 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-d95295a1-a81b-4f7f-81d8-5af8749da372 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:26:59.890085 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-d95295a1-a81b-4f7f-81d8-5af8749da372 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028076 Sep 01 16:26:59.890759 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 6/12] 10.222.0.18 () {64 vars in 1336 bytes} [Thu Sep 1 16:26:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:27:02.217937 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-f12f5aff-2056-4442-8abd-99e4df19329e admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:02.219610 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-f12f5aff-2056-4442-8abd-99e4df19329e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002142 Sep 01 16:27:02.220186 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 7/13] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 1 16:27:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:02.671290 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-6e1d5c36-a274-4d88-8427-c90a60f10e6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048, "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:02.693522 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-6e1d5c36-a274-4d88-8427-c90a60f10e6f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.466938 Sep 01 16:27:02.694423 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 7/14] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 1 16:27:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:27:02.707108 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-b5ba2db7-5cc2-4c16-a2ad-597cc75b7e23 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:02.731048 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-b5ba2db7-5cc2-4c16-a2ad-597cc75b7e23 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027650 Sep 01 16:27:02.731630 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 8/15] 10.222.0.18 () {64 vars in 1336 bytes} [Thu Sep 1 16:27:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:27:05.058825 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-6e1d5c36-a274-4d88-8427-c90a60f10e6f admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:05.059871 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-6e1d5c36-a274-4d88-8427-c90a60f10e6f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Sep 01 16:27:05.060486 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 8/16] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 1 16:27:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:05.495582 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-2a2345d3-74a9-4eb7-a2d9-0086997faa9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d4", "swap": 0, "name": "ds4G", "disk": 20}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:05.517434 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-2a2345d3-74a9-4eb7-a2d9-0086997faa9f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449842 Sep 01 16:27:05.518170 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 9/17] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 1 16:27:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:27:05.530716 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-d2fa6544-8287-42cb-bafd-c0b1f312e201 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:05.557753 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-d2fa6544-8287-42cb-bafd-c0b1f312e201 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031089 Sep 01 16:27:05.559575 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 9/18] 10.222.0.18 () {64 vars in 1336 bytes} [Thu Sep 1 16:27:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:27:07.930597 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-2a2345d3-74a9-4eb7-a2d9-0086997faa9f admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:07.931571 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-2a2345d3-74a9-4eb7-a2d9-0086997faa9f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Sep 01 16:27:07.931980 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 10/19] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 1 16:27:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:08.365025 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-5832a55f-cf2c-4278-a338-b21719a635eb admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:08.394060 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-5832a55f-cf2c-4278-a338-b21719a635eb admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.455843 Sep 01 16:27:08.395154 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 10/20] 10.222.0.18 () {60 vars in 1292 bytes} [Thu Sep 1 16:27:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:27:10.711780 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-2a2345d3-74a9-4eb7-a2d9-0086997faa9f admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:10.712723 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-2a2345d3-74a9-4eb7-a2d9-0086997faa9f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 01 16:27:10.713126 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 11/21] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 1 16:27:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:11.126532 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-727c2327-d804-4aa7-85ac-e1feaf802c5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:11.145854 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-727c2327-d804-4aa7-85ac-e1feaf802c5b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.426512 Sep 01 16:27:11.146765 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 11/22] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 1 16:27:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:27:11.159279 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-39d391e8-34e8-4aac-be35-3aac35eb87da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:11.182769 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-39d391e8-34e8-4aac-be35-3aac35eb87da admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027162 Sep 01 16:27:11.183336 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 12/23] 10.222.0.18 () {64 vars in 1333 bytes} [Thu Sep 1 16:27:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:27:13.521320 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-727c2327-d804-4aa7-85ac-e1feaf802c5b admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:13.522417 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-727c2327-d804-4aa7-85ac-e1feaf802c5b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Sep 01 16:27:13.522831 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 1 16:27:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:13.930867 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-27527e42-21e9-482a-9427-32e204065005 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:13.953584 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-27527e42-21e9-482a-9427-32e204065005 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.419988 Sep 01 16:27:13.953584 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 13/25] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 1 16:27:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:27:13.962455 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-e7acced5-7eaf-4f0f-bfc3-39df31ba6a63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:13.989242 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-e7acced5-7eaf-4f0f-bfc3-39df31ba6a63 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030438 Sep 01 16:27:13.989924 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 13/26] 10.222.0.18 () {64 vars in 1333 bytes} [Thu Sep 1 16:27:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:27:16.516508 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-27527e42-21e9-482a-9427-32e204065005 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:16.517546 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-27527e42-21e9-482a-9427-32e204065005 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 01 16:27:16.518135 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 14/27] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 1 16:27:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:16.910882 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-874a06c3-aafe-436e-9d2a-c0bfb986e468 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "id": "3", "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:16.929032 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-874a06c3-aafe-436e-9d2a-c0bfb986e468 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.404949 Sep 01 16:27:16.929577 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 14/28] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 1 16:27:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:27:16.941597 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-202cba5c-371b-44ad-95a1-bd8f1f6a5864 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:16.965234 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-202cba5c-371b-44ad-95a1-bd8f1f6a5864 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027415 Sep 01 16:27:16.965801 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 15/29] 10.222.0.18 () {64 vars in 1333 bytes} [Thu Sep 1 16:27:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:27:19.280737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-874a06c3-aafe-436e-9d2a-c0bfb986e468 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:19.281745 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-874a06c3-aafe-436e-9d2a-c0bfb986e468 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Sep 01 16:27:19.282143 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 15/30] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 1 16:27:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:19.684939 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-1885f767-be31-4ecc-a520-fa8de5a27efc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "name": "m1.large", "id": "4", "swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:19.704531 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-1885f767-be31-4ecc-a520-fa8de5a27efc admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.416300 Sep 01 16:27:19.705322 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 16/31] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 1 16:27:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:27:19.717739 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-ae3e56ae-0a0d-4323-83a6-55b73a2ef201 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:19.741524 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-ae3e56ae-0a0d-4323-83a6-55b73a2ef201 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028000 Sep 01 16:27:19.746355 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 16/32] 10.222.0.18 () {64 vars in 1333 bytes} [Thu Sep 1 16:27:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:27:22.091454 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-1885f767-be31-4ecc-a520-fa8de5a27efc admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:22.093438 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-1885f767-be31-4ecc-a520-fa8de5a27efc admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002423 Sep 01 16:27:22.098574 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 17/33] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 1 16:27:22 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:22.539425 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-0e90e8f1-5b09-4613-aafb-05ad9ff8be4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "disk": 160, "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:22.560409 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-0e90e8f1-5b09-4613-aafb-05ad9ff8be4b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.460245 Sep 01 16:27:22.568490 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 17/34] 10.222.0.18 () {64 vars in 1283 bytes} [Thu Sep 1 16:27:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:27:22.573536 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-1f6eee43-a074-4f75-9366-3753aa56b066 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:22.578858 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:22.603738 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-1f6eee43-a074-4f75-9366-3753aa56b066 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033923 Sep 01 16:27:22.605058 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 18/35] 10.222.0.18 () {64 vars in 1333 bytes} [Thu Sep 1 16:27:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:27:44.943344 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-0e90e8f1-5b09-4613-aafb-05ad9ff8be4b admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:44.944414 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-0e90e8f1-5b09-4613-aafb-05ad9ff8be4b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Sep 01 16:27:44.944879 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 18/36] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 1 16:27:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:45.331932 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-fdf67cbe-c93f-47ee-b40e-29be04249242 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:45.350200 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-fdf67cbe-c93f-47ee-b40e-29be04249242 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398690 Sep 01 16:27:45.350761 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 19/37] 10.222.0.18 () {60 vars in 1292 bytes} [Thu Sep 1 16:27:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:27:46.392834 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-0e90e8f1-5b09-4613-aafb-05ad9ff8be4b admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:46.393834 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-0e90e8f1-5b09-4613-aafb-05ad9ff8be4b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Sep 01 16:27:46.394253 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 19/38] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 1 16:27:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:46.911870 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-fe0bb299-22e0-47cd-9d02-99f175fe5920 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:46.917415 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.wsgi [None req-fe0bb299-22e0-47cd-9d02-99f175fe5920 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-fe0bb299-22e0-47cd-9d02-99f175fe5920 admin admin] Request method failure captured: Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Accept: application/json Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Accept-Encoding: gzip, deflate Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Connection: keep-alive Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Content-Length: 0 Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Host: 10.222.0.18 Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Openstack-Api-Version: compute 2.90 Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Openstack-System-Scope: None Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: User-Agent: python-novaclient Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Auth-Token: gAAAAABjEN2CKo_MgvcNKHHsTFC4dLezb2UyVdPNtlW4jd-0G2R4Cbhze2FtIoUFKaj3aqBpDt_4ZZqBZUEEnwBsPhBdq-1pPa_CsFd9yHvGurDfctHSCS2keqKabIVPoEmlB6DuFaVv8yNH-WiNKgcgZgP4bJHu3gEzf-9dTuBMll23LrZ99tU Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Domain-Id: None Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Domain-Name: None Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Identity-Status: Confirmed Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Is-Admin-Project: True Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Project-Domain-Id: default Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Project-Domain-Name: Default Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Project-Id: 0d95c560fa484406b7dcc65daad0e99e Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Project-Name: admin Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Role: reader,admin,member Sep 01 16:27:46.920715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Roles: reader,admin,member Sep 01 16:27:46.922418 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:27:46.922418 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Tenant: admin Sep 01 16:27:46.922418 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Tenant-Id: 0d95c560fa484406b7dcc65daad0e99e Sep 01 16:27:46.922418 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Tenant-Name: admin Sep 01 16:27:46.922418 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-User: admin Sep 01 16:27:46.922418 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-User-Domain-Id: default Sep 01 16:27:46.922418 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-User-Domain-Name: Default Sep 01 16:27:46.922418 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-User-Id: eed887c1c93d4f24959b0f90e215c424 Sep 01 16:27:46.922418 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-User-Name: admin Sep 01 16:27:46.922418 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: method: > Sep 01 16:27:46.922418 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: exception: Flavor 42 could not be found. Sep 01 16:27:46.922418 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: action_args: {'id': '42'} Sep 01 16:27:46.922418 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:27:46.922418 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:27:46.923482 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 01 16:27:46.924938 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-fe0bb299-22e0-47cd-9d02-99f175fe5920 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:27:46.926227 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-fe0bb299-22e0-47cd-9d02-99f175fe5920 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.391936 Sep 01 16:27:46.926227 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 20/39] 10.222.0.18 () {60 vars in 1190 bytes} [Thu Sep 1 16:27:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:46.931724 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-ad92d0ad-7d29-4eac-a56f-b9da9a13798b admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:46.935906 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:46.955537 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-ad92d0ad-7d29-4eac-a56f-b9da9a13798b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027400 Sep 01 16:27:46.956068 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 20/40] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Sep 1 16:27:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:27:46.966282 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-e17d2d33-5132-4d86-93e2-1342a8b3b6e0 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:46.989710 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-e17d2d33-5132-4d86-93e2-1342a8b3b6e0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027606 Sep 01 16:27:46.990259 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 21/41] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Sep 1 16:27:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:27:46.999452 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-6d8451fd-c41d-4b2b-a82e-068a71790d69 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:47.005824 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.wsgi [None req-6d8451fd-c41d-4b2b-a82e-068a71790d69 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-6d8451fd-c41d-4b2b-a82e-068a71790d69 admin admin] Request method failure captured: Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Accept: application/json Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Accept-Encoding: gzip, deflate Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Connection: keep-alive Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Content-Length: 0 Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Host: 10.222.0.18 Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Openstack-Api-Version: compute 2.90 Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Openstack-System-Scope: None Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: User-Agent: python-novaclient Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Auth-Token: gAAAAABjEN2CKo_MgvcNKHHsTFC4dLezb2UyVdPNtlW4jd-0G2R4Cbhze2FtIoUFKaj3aqBpDt_4ZZqBZUEEnwBsPhBdq-1pPa_CsFd9yHvGurDfctHSCS2keqKabIVPoEmlB6DuFaVv8yNH-WiNKgcgZgP4bJHu3gEzf-9dTuBMll23LrZ99tU Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Domain-Id: None Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Domain-Name: None Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Identity-Status: Confirmed Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Is-Admin-Project: True Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Project-Domain-Id: default Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Project-Domain-Name: Default Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Project-Id: 0d95c560fa484406b7dcc65daad0e99e Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Project-Name: admin Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Role: reader,admin,member Sep 01 16:27:47.009072 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Roles: reader,admin,member Sep 01 16:27:47.011127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:27:47.011127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Tenant: admin Sep 01 16:27:47.011127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Tenant-Id: 0d95c560fa484406b7dcc65daad0e99e Sep 01 16:27:47.011127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Tenant-Name: admin Sep 01 16:27:47.011127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-User: admin Sep 01 16:27:47.011127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-User-Domain-Id: default Sep 01 16:27:47.011127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-User-Domain-Name: Default Sep 01 16:27:47.011127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-User-Id: eed887c1c93d4f24959b0f90e215c424 Sep 01 16:27:47.011127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-User-Name: admin Sep 01 16:27:47.011127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: method: > Sep 01 16:27:47.011127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: exception: Flavor 42 could not be found. Sep 01 16:27:47.011127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: action_args: {'id': '42'} Sep 01 16:27:47.011127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:27:47.011127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:27:47.012075 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 01 16:27:47.013352 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-6d8451fd-c41d-4b2b-a82e-068a71790d69 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:27:47.014566 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-6d8451fd-c41d-4b2b-a82e-068a71790d69 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015061 Sep 01 16:27:47.014566 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 21/42] 10.222.0.18 () {60 vars in 1190 bytes} [Thu Sep 1 16:27:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:47.963915 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-e17d2d33-5132-4d86-93e2-1342a8b3b6e0 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:47.964924 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-e17d2d33-5132-4d86-93e2-1342a8b3b6e0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 01 16:27:47.965315 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 22/43] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 1 16:27:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:48.484734 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-029943ac-b4e7-4b77-a55b-2bc9518aa2bd admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:48.490081 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.wsgi [None req-029943ac-b4e7-4b77-a55b-2bc9518aa2bd admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-029943ac-b4e7-4b77-a55b-2bc9518aa2bd admin admin] Request method failure captured: Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Accept: application/json Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Accept-Encoding: gzip, deflate Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Connection: keep-alive Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Content-Length: 0 Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Host: 10.222.0.18 Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Openstack-Api-Version: compute 2.90 Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Openstack-System-Scope: None Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: User-Agent: python-novaclient Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Auth-Token: gAAAAABjEN2D-JRhJ8yIOfh8GY8efP9iLEVYxILIzx220bf-wes9dq_ixI-6Bp5q_Crfb7pVNcOdSrNPiK7D1oSAED_8Iy6Ng0yjfM4LeMb3LyWvMDufg4RnOz6SiAO6zrOJIBSTfnf-MQ9GmQIi0zFnsqYIN_aymcGbq0unqUBol2K_C5Uli5w Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Domain-Id: None Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Domain-Name: None Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Identity-Status: Confirmed Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Is-Admin-Project: True Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Project-Domain-Id: default Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Project-Domain-Name: Default Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Project-Id: 0d95c560fa484406b7dcc65daad0e99e Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Project-Name: admin Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Role: reader,admin,member Sep 01 16:27:48.491625 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Roles: reader,admin,member Sep 01 16:27:48.493059 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:27:48.493059 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Tenant: admin Sep 01 16:27:48.493059 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Tenant-Id: 0d95c560fa484406b7dcc65daad0e99e Sep 01 16:27:48.493059 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Tenant-Name: admin Sep 01 16:27:48.493059 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-User: admin Sep 01 16:27:48.493059 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-User-Domain-Id: default Sep 01 16:27:48.493059 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-User-Domain-Name: Default Sep 01 16:27:48.493059 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-User-Id: eed887c1c93d4f24959b0f90e215c424 Sep 01 16:27:48.493059 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-User-Name: admin Sep 01 16:27:48.493059 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: method: > Sep 01 16:27:48.493059 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: exception: Flavor 84 could not be found. Sep 01 16:27:48.493059 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: action_args: {'id': '84'} Sep 01 16:27:48.493059 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:27:48.493059 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:27:48.494541 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 01 16:27:48.495929 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-029943ac-b4e7-4b77-a55b-2bc9518aa2bd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:27:48.497127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-029943ac-b4e7-4b77-a55b-2bc9518aa2bd admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389523 Sep 01 16:27:48.497127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 22/44] 10.222.0.18 () {60 vars in 1190 bytes} [Thu Sep 1 16:27:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:48.503102 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-c6263b4b-f3d1-4762-a9af-084388f2919a admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:48.517772 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-c6263b4b-f3d1-4762-a9af-084388f2919a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018233 Sep 01 16:27:48.518308 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Sep 1 16:27:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:27:48.527329 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-44d171ce-784a-428e-bf06-a9003af879e3 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:48.542534 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-44d171ce-784a-428e-bf06-a9003af879e3 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018622 Sep 01 16:27:48.543047 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Sep 1 16:27:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:27:48.551783 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-b1e3e19d-6615-49c5-a222-441d7a2e3808 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:48.556977 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.wsgi [None req-b1e3e19d-6615-49c5-a222-441d7a2e3808 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-b1e3e19d-6615-49c5-a222-441d7a2e3808 admin admin] Request method failure captured: Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Accept: application/json Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Accept-Encoding: gzip, deflate Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Connection: keep-alive Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Content-Length: 0 Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Host: 10.222.0.18 Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Openstack-Api-Version: compute 2.90 Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Openstack-System-Scope: None Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: User-Agent: python-novaclient Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Auth-Token: gAAAAABjEN2D-JRhJ8yIOfh8GY8efP9iLEVYxILIzx220bf-wes9dq_ixI-6Bp5q_Crfb7pVNcOdSrNPiK7D1oSAED_8Iy6Ng0yjfM4LeMb3LyWvMDufg4RnOz6SiAO6zrOJIBSTfnf-MQ9GmQIi0zFnsqYIN_aymcGbq0unqUBol2K_C5Uli5w Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Domain-Id: None Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Domain-Name: None Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Identity-Status: Confirmed Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Is-Admin-Project: True Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Project-Domain-Id: default Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Project-Domain-Name: Default Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Project-Id: 0d95c560fa484406b7dcc65daad0e99e Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Project-Name: admin Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Role: reader,admin,member Sep 01 16:27:48.558506 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Roles: reader,admin,member Sep 01 16:27:48.560025 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:27:48.560025 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Tenant: admin Sep 01 16:27:48.560025 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Tenant-Id: 0d95c560fa484406b7dcc65daad0e99e Sep 01 16:27:48.560025 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Tenant-Name: admin Sep 01 16:27:48.560025 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-User: admin Sep 01 16:27:48.560025 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-User-Domain-Id: default Sep 01 16:27:48.560025 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-User-Domain-Name: Default Sep 01 16:27:48.560025 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-User-Id: eed887c1c93d4f24959b0f90e215c424 Sep 01 16:27:48.560025 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-User-Name: admin Sep 01 16:27:48.560025 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: method: > Sep 01 16:27:48.560025 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: exception: Flavor 84 could not be found. Sep 01 16:27:48.560025 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: action_args: {'id': '84'} Sep 01 16:27:48.560025 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:27:48.560025 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:27:48.560839 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 01 16:27:48.562057 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-b1e3e19d-6615-49c5-a222-441d7a2e3808 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:27:48.563119 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-b1e3e19d-6615-49c5-a222-441d7a2e3808 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011437 Sep 01 16:27:48.563119 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 24/47] 10.222.0.18 () {60 vars in 1190 bytes} [Thu Sep 1 16:27:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:49.640956 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-44d171ce-784a-428e-bf06-a9003af879e3 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:49.641956 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-44d171ce-784a-428e-bf06-a9003af879e3 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Sep 01 16:27:49.642368 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 24/48] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 1 16:27:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:50.179468 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-a1bb0629-88b1-4fc3-8347-71514fdef48e admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:50.185182 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.wsgi [None req-a1bb0629-88b1-4fc3-8347-71514fdef48e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-a1bb0629-88b1-4fc3-8347-71514fdef48e admin admin] Request method failure captured: Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Accept: application/json Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Accept-Encoding: gzip, deflate Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Connection: keep-alive Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Content-Length: 0 Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Host: 10.222.0.18 Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Openstack-Api-Version: compute 2.90 Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Openstack-System-Scope: None Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: User-Agent: python-novaclient Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Auth-Token: gAAAAABjEN2FKQGl9mKJqFN2AWhgwuQvRm8Tv9QRhtNr8aRwGxkEi01RGdYDaSqDJLCegYiQbGNohX-gP1VAF-1sOClYjcc0Enfo1Nz_xJY6fJejiJB9QtZgjCQWqVZgjzm0widu5R7pfZj5qJmAeR9t0xcdMi44Qo0G6cIY69cgy61YAJAOKu0 Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Domain-Id: None Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Domain-Name: None Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Identity-Status: Confirmed Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Is-Admin-Project: True Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Project-Domain-Id: default Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Project-Domain-Name: Default Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Project-Id: 0d95c560fa484406b7dcc65daad0e99e Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Project-Name: admin Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Role: reader,admin,member Sep 01 16:27:50.186715 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Roles: reader,admin,member Sep 01 16:27:50.188279 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:27:50.188279 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Tenant: admin Sep 01 16:27:50.188279 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Tenant-Id: 0d95c560fa484406b7dcc65daad0e99e Sep 01 16:27:50.188279 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-Tenant-Name: admin Sep 01 16:27:50.188279 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-User: admin Sep 01 16:27:50.188279 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-User-Domain-Id: default Sep 01 16:27:50.188279 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-User-Domain-Name: Default Sep 01 16:27:50.188279 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-User-Id: eed887c1c93d4f24959b0f90e215c424 Sep 01 16:27:50.188279 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: X-User-Name: admin Sep 01 16:27:50.188279 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: method: > Sep 01 16:27:50.188279 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: exception: Flavor 451 could not be found. Sep 01 16:27:50.188279 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: action_args: {'id': '451'} Sep 01 16:27:50.188279 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:27:50.188279 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:27:50.190306 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 01 16:27:50.191392 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-a1bb0629-88b1-4fc3-8347-71514fdef48e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:27:50.192463 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-a1bb0629-88b1-4fc3-8347-71514fdef48e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.405586 Sep 01 16:27:50.192463 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 25/49] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Sep 1 16:27:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:50.198129 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-81d9b7af-499e-422a-8c16-3b194cca4208 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:50.212688 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-81d9b7af-499e-422a-8c16-3b194cca4208 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018559 Sep 01 16:27:50.213747 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 25/50] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Sep 1 16:27:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:27:50.222813 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-32722e5b-23f1-41d3-90e0-18f65877544c admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:50.238013 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-32722e5b-23f1-41d3-90e0-18f65877544c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018640 Sep 01 16:27:50.238569 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 26/51] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Sep 1 16:27:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:27:50.247501 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-2680ea2d-c480-4b64-968c-f2fef65292c1 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:50.252674 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.wsgi [None req-2680ea2d-c480-4b64-968c-f2fef65292c1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-2680ea2d-c480-4b64-968c-f2fef65292c1 admin admin] Request method failure captured: Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Accept: application/json Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Accept-Encoding: gzip, deflate Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Connection: keep-alive Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Content-Length: 0 Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Host: 10.222.0.18 Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Openstack-Api-Version: compute 2.90 Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Openstack-System-Scope: None Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: User-Agent: python-novaclient Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Auth-Token: gAAAAABjEN2FKQGl9mKJqFN2AWhgwuQvRm8Tv9QRhtNr8aRwGxkEi01RGdYDaSqDJLCegYiQbGNohX-gP1VAF-1sOClYjcc0Enfo1Nz_xJY6fJejiJB9QtZgjCQWqVZgjzm0widu5R7pfZj5qJmAeR9t0xcdMi44Qo0G6cIY69cgy61YAJAOKu0 Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Domain-Id: None Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Domain-Name: None Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Identity-Status: Confirmed Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Is-Admin-Project: True Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Project-Domain-Id: default Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Project-Domain-Name: Default Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Project-Id: 0d95c560fa484406b7dcc65daad0e99e Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Project-Name: admin Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Role: reader,admin,member Sep 01 16:27:50.254156 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Roles: reader,admin,member Sep 01 16:27:50.255700 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d95c560fa484406b7dcc65daad0e99e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:27:50.255700 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Tenant: admin Sep 01 16:27:50.255700 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Tenant-Id: 0d95c560fa484406b7dcc65daad0e99e Sep 01 16:27:50.255700 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-Tenant-Name: admin Sep 01 16:27:50.255700 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-User: admin Sep 01 16:27:50.255700 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-User-Domain-Id: default Sep 01 16:27:50.255700 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-User-Domain-Name: Default Sep 01 16:27:50.255700 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-User-Id: eed887c1c93d4f24959b0f90e215c424 Sep 01 16:27:50.255700 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: X-User-Name: admin Sep 01 16:27:50.255700 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: method: > Sep 01 16:27:50.255700 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: exception: Flavor 451 could not be found. Sep 01 16:27:50.255700 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: action_args: {'id': '451'} Sep 01 16:27:50.255700 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:27:50.255700 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:27:50.256737 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: ERROR nova.api.openstack.wsgi Sep 01 16:27:50.257796 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-2680ea2d-c480-4b64-968c-f2fef65292c1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:27:50.258868 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-2680ea2d-c480-4b64-968c-f2fef65292c1 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011458 Sep 01 16:27:50.258868 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 26/52] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Sep 1 16:27:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 16:27:51.212880 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-32722e5b-23f1-41d3-90e0-18f65877544c admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:51.213907 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-32722e5b-23f1-41d3-90e0-18f65877544c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002014 Sep 01 16:27:51.214314 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 27/53] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 1 16:27:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:51.735997 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-adaf93ac-1407-48fa-a738-5bb83d0122ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:51.755910 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-adaf93ac-1407-48fa-a738-5bb83d0122ae admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.405346 Sep 01 16:27:51.756453 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 27/54] 10.222.0.18 () {64 vars in 1235 bytes} [Thu Sep 1 16:27:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:27:52.718351 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-32722e5b-23f1-41d3-90e0-18f65877544c admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:52.719368 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-32722e5b-23f1-41d3-90e0-18f65877544c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 01 16:27:52.719761 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 28/55] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 1 16:27:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:53.240019 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-11d05019-dc0c-43c2-92a9-9a420f3b0b7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:53.257989 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-11d05019-dc0c-43c2-92a9-9a420f3b0b7b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.399575 Sep 01 16:27:53.258573 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 28/56] 10.222.0.18 () {64 vars in 1235 bytes} [Thu Sep 1 16:27:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:27:54.223518 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-32722e5b-23f1-41d3-90e0-18f65877544c admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:54.224600 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-32722e5b-23f1-41d3-90e0-18f65877544c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 01 16:27:54.224995 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 29/57] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 1 16:27:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:54.755131 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-aac22449-0f81-405c-8036-e88cf8d9c9a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:54.774283 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-aac22449-0f81-405c-8036-e88cf8d9c9a3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.399560 Sep 01 16:27:54.774815 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 29/58] 10.222.0.18 () {64 vars in 1235 bytes} [Thu Sep 1 16:27:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:27:55.731528 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-32722e5b-23f1-41d3-90e0-18f65877544c admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:55.732844 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-32722e5b-23f1-41d3-90e0-18f65877544c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001763 Sep 01 16:27:55.733235 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 30/59] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 1 16:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:56.254269 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-1475e47e-8a2b-4774-b3a3-7738b4d300c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:27:56.278882 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-1475e47e-8a2b-4774-b3a3-7738b4d300c9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.406699 Sep 01 16:27:56.279449 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 30/60] 10.222.0.18 () {64 vars in 1235 bytes} [Thu Sep 1 16:27:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:27:57.256957 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-32722e5b-23f1-41d3-90e0-18f65877544c admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:57.257998 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-32722e5b-23f1-41d3-90e0-18f65877544c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 01 16:27:57.258417 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 31/61] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 1 16:27:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:57.777943 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-e31a8de7-2595-404b-9329-1d25ef02c539 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:57.798707 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-e31a8de7-2595-404b-9329-1d25ef02c539 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.400148 Sep 01 16:27:57.799241 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 31/62] 10.222.0.18 () {60 vars in 1202 bytes} [Thu Sep 1 16:27:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:28:51.051217 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-32722e5b-23f1-41d3-90e0-18f65877544c admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:28:51.052344 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-32722e5b-23f1-41d3-90e0-18f65877544c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Sep 01 16:28:51.053236 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 32/63] 10.222.0.18 () {54 vars in 931 bytes} [Thu Sep 1 16:28:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:28:51.063895 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:51.460126 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-008a153b-c8fd-49d4-8feb-e1c52ccee8d0 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:28:51.483144 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-008a153b-c8fd-49d4-8feb-e1c52ccee8d0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.423347 Sep 01 16:28:51.483686 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 32/64] 10.222.0.18 () {60 vars in 1292 bytes} [Thu Sep 1 16:28:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:28:51.504805 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:51.509026 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-a82cc62d-5d32-4534-8144-8921b5176a5b admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:28:51.516783 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-a82cc62d-5d32-4534-8144-8921b5176a5b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013457 Sep 01 16:28:51.517322 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 33/65] 10.222.0.18 () {60 vars in 1283 bytes} [Thu Sep 1 16:28:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:28:51.529948 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-0894b971-3574-4e09-adfa-2fb42bff550d admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:28:51.537652 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-0894b971-3574-4e09-adfa-2fb42bff550d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011447 Sep 01 16:28:51.538177 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 33/66] 10.222.0.18 () {60 vars in 1286 bytes} [Thu Sep 1 16:28:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:28:51.551342 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-55554e0f-e32d-45c4-aade-01b88a947d8c admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:28:51.559691 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-55554e0f-e32d-45c4-aade-01b88a947d8c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012472 Sep 01 16:28:51.560169 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 34/67] 10.222.0.18 () {60 vars in 1286 bytes} [Thu Sep 1 16:28:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:28:51.572076 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-fe74f370-782d-47b3-ac99-1e5374b61f20 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:28:51.579813 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-fe74f370-782d-47b3-ac99-1e5374b61f20 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011322 Sep 01 16:28:51.581127 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 34/68] 10.222.0.18 () {60 vars in 1283 bytes} [Thu Sep 1 16:28:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:57.491307 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-55554e0f-e32d-45c4-aade-01b88a947d8c admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:57.492324 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-55554e0f-e32d-45c4-aade-01b88a947d8c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 01 16:31:57.492720 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 35/69] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 1 16:31:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:57.637080 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_api:SELECT=6 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:57.791038 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-3df53641-1a13-47b8-bbe9-40ab77c62679 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:57.794385 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-3df53641-1a13-47b8-bbe9-40ab77c62679 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:57.794885 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-3df53641-1a13-47b8-bbe9-40ab77c62679 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:57.795306 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-3df53641-1a13-47b8-bbe9-40ab77c62679 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:57.796010 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-3df53641-1a13-47b8-bbe9-40ab77c62679 admin admin] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:57.796449 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-3df53641-1a13-47b8-bbe9-40ab77c62679 admin admin] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:57.796859 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-3df53641-1a13-47b8-bbe9-40ab77c62679 admin admin] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:57.830401 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-3df53641-1a13-47b8-bbe9-40ab77c62679 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.198792 Sep 01 16:31:57.830958 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 35/70] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Sep 1 16:31:57 2022] GET /compute/v2.1/os-services => generated 794 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:31:58.648771 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-55554e0f-e32d-45c4-aade-01b88a947d8c admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:58.649767 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-55554e0f-e32d-45c4-aade-01b88a947d8c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Sep 01 16:31:58.650159 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 36/71] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 1 16:31:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:58.840043 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-4016bdd7-3d29-47a2-b5b8-4fd73360d23d admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:58.843402 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-4016bdd7-3d29-47a2-b5b8-4fd73360d23d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:58.843869 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-4016bdd7-3d29-47a2-b5b8-4fd73360d23d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:58.844301 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-4016bdd7-3d29-47a2-b5b8-4fd73360d23d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:58.845004 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-4016bdd7-3d29-47a2-b5b8-4fd73360d23d admin admin] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:58.845466 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-4016bdd7-3d29-47a2-b5b8-4fd73360d23d admin admin] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:58.845849 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-4016bdd7-3d29-47a2-b5b8-4fd73360d23d admin admin] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:58.867674 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-4016bdd7-3d29-47a2-b5b8-4fd73360d23d admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.079079 Sep 01 16:31:58.868165 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 36/72] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Sep 1 16:31:58 2022] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:32:10.097992 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-55554e0f-e32d-45c4-aade-01b88a947d8c admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:10.099024 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-55554e0f-e32d-45c4-aade-01b88a947d8c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 01 16:32:10.099413 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 1 16:32:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:32:10.242395 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_cell0:SELECT=4 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:10.243154 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_cell1:SELECT=4 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:10.243756 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG dbcounter [-] [105707] Writing DB stats nova_api:SELECT=8 {{(pid=105707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:10.291164 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-bde8389a-7366-4906-b5ee-b1e0d2eec4c5 admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:10.295282 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-bde8389a-7366-4906-b5ee-b1e0d2eec4c5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:10.295756 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-bde8389a-7366-4906-b5ee-b1e0d2eec4c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:10.296183 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-bde8389a-7366-4906-b5ee-b1e0d2eec4c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:10.296890 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-bde8389a-7366-4906-b5ee-b1e0d2eec4c5 admin admin] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:10.297336 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-bde8389a-7366-4906-b5ee-b1e0d2eec4c5 admin admin] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:10.297753 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-bde8389a-7366-4906-b5ee-b1e0d2eec4c5 admin admin] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:10.322987 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-bde8389a-7366-4906-b5ee-b1e0d2eec4c5 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.085025 Sep 01 16:32:10.323962 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 37/74] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Sep 1 16:32:10 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:32:11.154492 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-55554e0f-e32d-45c4-aade-01b88a947d8c admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:11.155495 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-55554e0f-e32d-45c4-aade-01b88a947d8c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 01 16:32:11.155897 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 38/75] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Sep 1 16:32:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:32:11.345426 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG nova.api.openstack.wsgi [None req-ba28f30e-1707-4aad-9874-8446e1d7935b admin admin] Calling method '>' {{(pid=105707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:11.348809 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-ba28f30e-1707-4aad-9874-8446e1d7935b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:11.349283 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-ba28f30e-1707-4aad-9874-8446e1d7935b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:11.349743 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-ba28f30e-1707-4aad-9874-8446e1d7935b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:11.350531 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-ba28f30e-1707-4aad-9874-8446e1d7935b admin admin] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:11.350982 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-ba28f30e-1707-4aad-9874-8446e1d7935b admin admin] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:11.351397 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: DEBUG oslo_concurrency.lockutils [None req-ba28f30e-1707-4aad-9874-8446e1d7935b admin admin] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:11.374301 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: INFO nova.api.openstack.requestlog [None req-ba28f30e-1707-4aad-9874-8446e1d7935b admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.079052 Sep 01 16:32:11.374861 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: [pid: 105707|app: 0|req: 38/76] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Sep 1 16:32:11 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:09.721938 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: Thu Sep 1 16:33:09 2022 - graceful shutdown triggered... Sep 01 16:33:09.722044 dv-cinder-852209-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 16:33:09.722891 dv-cinder-852209-10-iscsi devstack@n-api.service[105707]: Gracefully killing worker 1 (pid: 105707)... Sep 01 16:33:09.723879 dv-cinder-852209-10-iscsi devstack@n-api.service[105708]: Gracefully killing worker 2 (pid: 105708)... Sep 01 16:33:10.722566 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: worker 1 buried after 1 seconds Sep 01 16:33:10.723058 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: worker 2 buried after 1 seconds Sep 01 16:33:10.723058 dv-cinder-852209-10-iscsi devstack@n-api.service[105706]: goodbye to uWSGI. Sep 01 16:33:10.724129 dv-cinder-852209-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 16:33:10.724679 dv-cinder-852209-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 16:33:10.727508 dv-cinder-852209-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 16:33:10.740720 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 16:33:10.742350 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 16:33:10 2022] *** Sep 01 16:33:10.742350 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 16:33:10.742350 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 16:33:10.742350 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: nodename: dv-cinder-852209-10-iscsi Sep 01 16:33:10.742350 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: machine: x86_64 Sep 01 16:33:10.742350 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: clock source: unix Sep 01 16:33:10.742350 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: pcre jit disabled Sep 01 16:33:10.742350 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: detected number of CPU cores: 4 Sep 01 16:33:10.742350 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: current working directory: / Sep 01 16:33:10.742350 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: detected binary path: /usr/bin/uwsgi-core Sep 01 16:33:10.742350 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: your processes number limit is 47680 Sep 01 16:33:10.742350 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: your memory page size is 4096 bytes Sep 01 16:33:10.742350 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: detected max file descriptor number: 2048 Sep 01 16:33:10.742350 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: lock engine: pthread robust mutexes Sep 01 16:33:10.743965 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: thunder lock: enabled Sep 01 16:33:10.743965 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 16:33:10.743965 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 16:33:10.784231 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: Python main interpreter initialized at 0x55593222e9c0 Sep 01 16:33:10.784231 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: python threads support enabled Sep 01 16:33:10.784231 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: your server socket listen backlog is limited to 100 connections Sep 01 16:33:10.784231 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: your mercy for graceful operations on workers is 90 seconds Sep 01 16:33:10.784709 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 16:33:10.784709 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: *** Operational MODE: preforking *** Sep 01 16:33:10.784949 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: *** uWSGI is running in multiple interpreter mode *** Sep 01 16:33:10.784949 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: spawned uWSGI master process (pid: 127156) Sep 01 16:33:10.785159 dv-cinder-852209-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 16:33:10.785758 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: spawned uWSGI worker 1 (pid: 127177, cores: 1) Sep 01 16:33:10.786286 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: spawned uWSGI worker 2 (pid: 127178, cores: 1) Sep 01 16:33:10.786691 dv-cinder-852209-10-iscsi devstack@n-api.service[127156]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 16:33:11.450904 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 16:33:11.460561 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 16:33:12.600488 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:33:12.600488 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: from cryptography.utils import int_from_bytes Sep 01 16:33:12.601108 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:33:12.601108 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: from cryptography.utils import int_from_bytes Sep 01 16:33:12.615965 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:33:12.615965 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: from cryptography.utils import int_from_bytes Sep 01 16:33:12.616503 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:33:12.616503 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: from cryptography.utils import int_from_bytes Sep 01 16:33:15.042706 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:33:15.043317 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:33:15.043490 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:33:15.043851 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:33:15.044101 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:33:15.045005 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.045332 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.045658 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.046060 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.046365 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.046621 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.046940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.047256 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.047579 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.047837 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.048151 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.048473 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-10-iscsi {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.048944 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.049252 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.049565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.049881 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.050186 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.050533 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.050836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.051338 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.052557 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.052557 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.052557 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.052818 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.053042 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.053353 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.053671 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.053877 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:33:15.054304 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.054394 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:33:15.054490 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.054610 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.054736 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:33:15.055009 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-10-iscsi {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.055114 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:33:15.055267 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:33:15.055363 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.055620 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.055743 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.055932 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.056049 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.056285 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.056385 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.056846 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.056955 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.056955 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.057130 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.057222 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.057311 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.057540 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.057644 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.057846 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.057947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.058174 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.058288 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.058460 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.058564 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.058775 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.058873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.059109 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-10-iscsi {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.059211 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.059405 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.059565 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.059723 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.059877 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.060029 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.060747 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.060910 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.061066 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.061217 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.061375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.061521 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.061698 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.061801 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.062006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.062113 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.062400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.062536 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.062721 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.062846 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.063039 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.063140 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.063289 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.063450 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.063552 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.063787 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.063907 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.064101 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.064214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.064409 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.064508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.064725 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.064824 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.065030 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.065123 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.065335 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.065434 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.065640 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.065743 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.065962 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.066068 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-10-iscsi {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.066261 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.066369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.066573 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.066672 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.066887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.066986 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.067198 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.067355 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.067517 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.067666 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.067823 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.067977 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.068138 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.068297 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.068532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.068631 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.068782 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.068916 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.069089 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.069241 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.069425 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.069557 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.070159 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.070159 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.070408 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.070506 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.070590 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.070807 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.070900 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.071113 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.071214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.071429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.071573 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.071732 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.071832 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.072034 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.072135 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.072283 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.072385 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.072590 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.072690 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.072910 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.073010 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.073229 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.073367 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.073526 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.073618 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.073792 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.073928 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.074044 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.074140 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.074391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.074516 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.074712 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.074813 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.075025 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.075148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.075319 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.075425 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.075625 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.075718 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.075955 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.076054 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.076261 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.076362 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.076566 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.076664 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.076870 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.076960 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.077175 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.077338 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.077482 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.077629 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.077783 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.077933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.078085 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.078225 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.078344 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.078431 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.078659 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.078752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.078976 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.079122 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.079281 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.079381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.079585 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.079684 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.080901 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.081076 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.081214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.081361 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.081492 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.081630 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.081768 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.081898 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.082028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.082226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.082443 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.082534 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.082623 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.082707 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.082796 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.082893 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.082977 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.083066 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.083157 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.083246 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.083341 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.083482 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.083571 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.083664 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.083754 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.083844 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.084008 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.084108 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.084191 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.084296 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.084398 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.084489 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.084644 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.084770 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.084943 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.085041 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.085245 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.085345 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.085545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.085638 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.085844 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.085941 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.086144 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.086275 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.086469 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.086570 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.086763 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.086854 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.087077 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.087182 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.087387 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.087476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.087691 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.087788 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.087995 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.088101 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.088292 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.088393 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.088607 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.088706 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.088931 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.089033 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.089238 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.089329 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.089545 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.089635 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.089852 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.089943 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.090162 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.090291 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.090510 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.090605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.090815 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.090927 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.091121 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.091243 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.091970 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.092142 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.092298 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.092451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.092600 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.092749 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.092891 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.093165 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.093307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.093472 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.093621 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.093783 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.093930 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.094081 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.094249 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.094404 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.094504 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.094725 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.094836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.095035 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.095135 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.095342 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.095456 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.095651 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.095870 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.096014 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.096159 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.096308 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.096474 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.096612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.096759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.096894 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.097052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.097195 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.097345 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.097500 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.097639 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.097786 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.097940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.098076 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.098225 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.098384 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.098523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.098693 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.098845 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.099017 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.099166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.099321 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:33:15.099468 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.099687 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.099782 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.099997 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.100099 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.100313 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.100416 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.100628 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.100726 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.100938 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.101045 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.101260 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.101357 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.101572 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.101670 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.101907 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.102038 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.102216 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.102370 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.102564 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.102660 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.102875 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.103028 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.103209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.103336 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.103527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.103680 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.103843 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.103944 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.104227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.104336 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.104507 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.104669 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.104828 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.105005 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.105206 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.105313 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.105486 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.105694 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.105860 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.106064 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.106166 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.106686 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.106827 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.107024 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.107686 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.107857 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.108045 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.108200 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.108347 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.108535 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.108696 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.108847 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.109018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.109172 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.109347 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.109500 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.109671 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.109804 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.110068 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.110212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.110437 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.110545 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.110811 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.110961 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.111122 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.111216 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.111498 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.111618 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.111751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.111842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.112063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.112169 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.112383 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.112495 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.112686 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.112785 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.112997 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.113086 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.113308 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.113409 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.113615 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.113720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.113927 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.114035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.114268 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.114375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.114561 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.114652 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.114877 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.114977 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.115189 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.115280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.115503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.115610 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.115820 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.115919 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.116132 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.116220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.116481 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.116580 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.116747 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.116846 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.117061 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.117170 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.117365 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.117471 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.117670 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.117774 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.117983 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.118081 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.118312 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.118432 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.118637 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.118737 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.118951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.119048 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.119255 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.119346 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.119564 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.119672 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.119868 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.119958 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.120172 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.120270 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.120474 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.120579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.120786 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.120927 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.121086 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.121237 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.121388 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.121482 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.121690 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.121784 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.121991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.122089 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.122312 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.122419 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.122658 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.122755 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.122964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.123063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.123265 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.123366 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.123568 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.123660 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.123872 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.123978 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.124184 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.124275 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.124496 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.124596 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.124809 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.124914 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.125123 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.125229 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.125431 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.125534 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.125754 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.125861 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.126069 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.126170 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.126404 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.126511 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.126714 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.126820 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.127031 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.127137 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.127340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.127441 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.127652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.127745 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.127974 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.128074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.128286 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.128384 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.128590 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.128683 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.128901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.128999 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.129204 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.129303 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.129513 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.129607 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.129817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.129908 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.130123 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.130221 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.130448 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.130541 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.130749 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.130849 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.131053 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.131166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.131351 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.131457 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.131649 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.131737 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.131969 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.132071 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.132279 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.132373 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.132582 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.132674 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.132884 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.132985 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.133185 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.133276 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.133507 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.133614 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.133813 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.133914 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.134123 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.134222 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.134465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.134565 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.134777 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.134882 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.135101 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.135214 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.135414 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.135520 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.135726 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.135818 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.136025 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.136124 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.136337 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.136434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.136649 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.136741 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.136960 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.137164 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.137264 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.137347 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.137573 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.137676 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.137892 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.137989 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.138220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.138347 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.138551 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.138645 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.138863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.138963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.139168 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.139275 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.139473 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.139565 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.139781 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.139881 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.140093 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.140195 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.140401 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.140501 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.140711 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.140811 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.141018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.141118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.141332 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.141456 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.141643 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.141751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.141946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.142047 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.142336 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.142511 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.142627 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.142708 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.142877 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.142979 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.143187 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.143278 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.143495 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.143585 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.143811 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.143917 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.144114 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.144243 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.144417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.144510 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.144727 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.144825 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.145034 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.145133 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.145336 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.145441 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.145666 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.145781 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.146002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.146134 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.146329 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.146501 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.146638 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.146876 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.147094 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.147325 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.147476 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.147627 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.147787 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.147930 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.148080 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.148223 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.148360 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.148514 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.148661 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.148802 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.148937 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.149097 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.149252 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.149401 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.149543 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.149683 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.149830 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.149970 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.150121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.150323 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.150463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.150605 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.150746 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.150897 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.151055 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.151215 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.151310 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.151425 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.151525 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.151740 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.151888 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.152063 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.152262 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.152379 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.152467 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.152665 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.152771 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.152978 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.153125 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.153275 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.153422 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.153577 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.154399 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.154517 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.154734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.154883 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.155041 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.155150 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.155346 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.155439 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.155667 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.155809 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.155993 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.156096 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.156308 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.156407 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.156613 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.156713 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.156934 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.157034 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.157237 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.157352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.157550 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.157663 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.157852 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.157954 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.158154 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.158278 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.158491 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.158584 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.158795 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.158889 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.159099 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.159201 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.159403 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.159503 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.159711 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.159804 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.160014 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.160116 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.160315 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.160407 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.160617 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.160715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.160920 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.161091 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.161234 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.161327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.161536 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.161629 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.161850 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.162041 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.162166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.162310 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.162489 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.162601 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.162798 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.162902 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.163103 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.163373 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.163466 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.163694 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.163795 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.164014 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.164112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.164321 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.164410 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.164654 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.164761 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.164973 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.165073 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.165306 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.165407 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.165607 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.165698 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.165908 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.166009 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.166227 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.166379 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.166549 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.166649 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.166851 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.166946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.167155 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.167251 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.167464 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.167556 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.167769 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.167873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.168069 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.168161 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.168370 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.168462 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.168677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.168776 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.168979 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.169072 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.169282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.169383 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.169657 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.169765 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.169969 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.170063 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.170291 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.170391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.170606 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.170712 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.170913 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.171014 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.171214 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.171312 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.171512 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.171612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.171820 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.171920 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.172126 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.172222 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.172443 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.172575 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.172737 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.172846 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.173037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.173129 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.173350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.173444 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.173653 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.173746 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.173955 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.174048 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.174269 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.174364 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.174580 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.174674 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.174887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.174981 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.175188 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.175292 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.175505 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.175597 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.175815 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.175907 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.176117 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.176252 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.176418 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.176510 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.176724 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.176824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.177022 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.177121 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.177323 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.177423 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.177629 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.177728 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.177941 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.178041 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.178287 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.178399 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.178571 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.178672 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.178878 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.178977 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.179180 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.179279 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.179484 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.179595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.179785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.179887 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.180087 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.180179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.180387 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.180479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.180687 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.180779 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.180988 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.181081 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.181288 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.181380 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.181586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.181722 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.181892 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.181984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.182200 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.182319 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.182614 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.182724 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.182861 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.182988 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.183122 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.183261 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.183445 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.183537 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.183750 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.183852 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.184050 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.184141 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.184372 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.184465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.184685 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.184791 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.184989 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.185604 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.185822 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.185925 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.186131 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.186261 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.186457 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.186560 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.186758 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.186858 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.187073 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.187181 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.187384 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.187485 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.187698 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.187823 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.188001 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.188108 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.188303 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.188395 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.188605 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.188704 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.188914 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.189009 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.189220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.189310 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.189530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.189625 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.189832 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.189941 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.190137 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.190229 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.190465 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.190555 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.190771 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.190889 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.191074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.191191 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.191381 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.191480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.191694 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.191797 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.191996 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.192095 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.192304 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.192485 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.192636 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.192727 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.192920 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.193029 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.193278 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.193393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.193537 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.193646 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.193877 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.194474 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.194584 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.194730 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.194861 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.194954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.195048 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.195132 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.195226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.195344 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.195491 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.195651 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.195797 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.195955 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.196112 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.196251 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.196424 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.196551 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.196734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.196863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.197038 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.197166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.197340 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.197593 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.197686 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.197909 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.198016 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.198221 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.198341 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.198551 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.198691 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.198844 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.199003 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.199156 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.199257 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.199471 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.199572 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.199785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.199879 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.200147 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.200266 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.200400 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.200492 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.200734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.200839 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.201650 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.201781 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.201997 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.202098 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.202323 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.202473 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.202631 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.202724 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.202941 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.203097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.203254 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.203349 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.203557 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.203651 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.203862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.203969 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.204165 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.204266 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.204469 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.204568 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.204777 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.204877 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.205089 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.205183 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.205393 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.205485 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.205702 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.205805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.206010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.206141 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.206345 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.206514 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.206646 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.206825 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.207080 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.207193 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.207398 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.207496 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.207711 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.207806 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.208060 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.208239 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.208381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.208538 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.208691 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.208836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.208979 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.209127 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.209269 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.209409 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.209562 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.209710 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.209883 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.210028 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.210186 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.210354 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.210516 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.210657 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.210826 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.210975 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.211149 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.211299 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.211443 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.211597 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.211819 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.211974 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.212074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.212167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.212345 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.212478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.212653 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.212796 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.212957 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.213118 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.213278 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.213443 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.213710 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.213815 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.214043 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.214136 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.214374 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.214483 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.214682 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.214785 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.215004 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.215146 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.215312 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.215488 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.215619 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.215803 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.215934 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.216136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.216246 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.216462 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.216571 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.216786 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.216879 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.217113 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.217213 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.217420 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.217521 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.217732 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.217833 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.218043 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.218143 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.218384 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.218495 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.218707 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.218799 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.219019 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.219116 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.219322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.219423 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.219627 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.219719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.219941 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.220034 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.220249 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.220342 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.220553 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.220660 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.220858 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.220957 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.221200 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.221294 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.221503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.221603 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.221823 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.221922 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.222155 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.222266 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.222523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.222616 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.222829 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.222972 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.223137 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.223230 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.223448 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.223552 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.223754 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.223864 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.224061 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.224162 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.224384 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.224477 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.224686 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.224791 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.224990 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.225089 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.225300 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.225394 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.225603 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.225709 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.225906 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.226005 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.226206 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.226387 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.226538 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.226639 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.226843 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.226936 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.227146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.227250 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.227450 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.227544 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.227772 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.227865 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.228075 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.228167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.228396 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.228490 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.228707 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.228799 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.229012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.229105 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.229317 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.229410 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.229620 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.229710 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.229932 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.230089 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.230306 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.230430 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.230616 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.230763 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.230938 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.231067 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.231538 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.231661 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.231864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.231992 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.232201 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.232316 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.232533 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.232634 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.232857 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.232957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.233175 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.233286 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.233492 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.233585 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.233806 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.233896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.234111 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.234202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.234438 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.234533 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.234749 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.234855 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.235054 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.235156 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.235357 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.235583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.235686 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.235919 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.236027 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.236237 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.236331 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.236539 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.236644 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.236844 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.236949 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.237161 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.237260 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.237464 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.237554 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.237780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.237872 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.238092 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.238182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.238425 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.238519 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.238733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.238828 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.239037 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.239139 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.239368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.239468 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.239673 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.239765 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.240009 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.240101 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.240322 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.240496 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.240637 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.240729 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.240954 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.241045 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.241273 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.241409 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.241587 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.241700 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.241901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.242005 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.242216 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.242361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.242551 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.242652 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.242869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.243005 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.243178 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.243323 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.243488 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.243617 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.243800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.243962 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.244114 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.244208 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.244427 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.244648 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.244749 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.244984 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.245085 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.245305 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.245444 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.245624 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.245725 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.245941 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.246044 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.246297 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.246431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.246597 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.246691 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.246910 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.247010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.247221 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.247313 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.247533 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.248153 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.248368 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.248572 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.248697 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.248889 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.249022 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.249223 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.249334 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.249548 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.249671 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.249871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.249996 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.250187 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.250336 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.250527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.250653 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.250854 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.250969 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.251159 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.251325 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.251463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.251643 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.251773 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.251951 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.252082 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.252278 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.252384 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.252575 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.252698 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.252889 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.253008 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.253198 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.253332 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.253511 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.253626 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.253824 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.253920 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.254135 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.254473 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.254581 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.254785 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.254891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.255099 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.255200 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.255411 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.255549 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.255735 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.255837 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.256047 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.256147 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.256352 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.256445 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.256674 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.256787 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.256978 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.257080 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.257282 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.257375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.257596 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.257805 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.257905 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.258122 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.258221 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.258496 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.258594 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.258805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.258897 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.259113 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.259214 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.259417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.259511 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.259727 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.259827 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.260029 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.260122 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.260352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.260444 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.260654 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.260745 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.260956 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.261050 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.261257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.261351 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.261558 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.261656 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.261858 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.261958 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.262159 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.262273 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.262489 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.262594 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.262790 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.262899 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.263099 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.263231 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.263955 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.264193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.264298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.264539 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.264641 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.264856 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.264949 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.265155 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.265255 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.265493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.265633 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.265815 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.265907 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.266124 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.266300 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.266474 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.266580 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.266784 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.266881 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.267091 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.267194 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.267398 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.267498 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.267707 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.267799 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.268016 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.268152 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.268319 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.268417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.268632 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.268728 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.268944 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.269054 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.269247 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.269480 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.269572 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.269812 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.269913 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.270131 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.270260 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.270486 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.270588 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.270788 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.270968 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.271093 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.271187 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.271396 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.271506 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.271696 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.271798 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.271999 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.272091 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.272305 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.272404 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.272608 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.272708 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.272917 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.273015 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.273217 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.273320 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.273524 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.273622 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.273827 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.273944 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.274138 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.274267 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.274466 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.274625 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.274781 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.274924 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.275065 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.275213 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.275362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.275505 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.275657 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.275796 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.275967 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.276103 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.276278 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.276478 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.276903 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.277049 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.277138 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.277221 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.277346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.277438 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.277521 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.277632 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.277828 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.277977 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.278146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.278317 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.278478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.278784 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.278895 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.279115 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.279217 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.279425 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.279518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.279742 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.279849 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.280069 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.280170 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.280382 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.280496 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.280690 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.280806 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.281026 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.281169 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.281344 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.281465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.281655 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.281790 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.281967 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.282071 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.282297 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.282435 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.282677 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.282808 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.282909 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.282995 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.283219 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.283315 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.283530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.283625 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.283843 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.283936 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.284207 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.284356 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.284508 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.284606 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.284758 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.284860 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.285069 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.285171 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.285383 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.285502 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.285698 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.285795 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.286016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.286150 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.286335 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.286444 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.286652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.286746 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.286961 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.287083 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.287263 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.287379 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.287567 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.287671 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.287873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.287975 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.288175 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.288264 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.288479 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.288580 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.288782 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.288883 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.289083 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.289175 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.289389 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.289480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.289689 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.289781 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.289992 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.290082 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.290333 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.290518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.290624 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.290835 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.290927 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.291154 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.291254 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.291475 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.291567 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.291786 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.291877 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.292089 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.292179 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.292398 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.292489 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.292700 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.292799 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.293003 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.293112 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.293321 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.293411 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.293649 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.293746 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.293961 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.294057 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.294303 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.294441 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.294647 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.294760 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.294953 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.295224 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.295317 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.295539 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.295631 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.295849 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.295948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.296169 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.296270 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.296476 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.296578 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.296780 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.296885 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.297085 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.297174 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.297397 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.297497 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.297701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.297815 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.298001 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.298109 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.298329 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.298436 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.298635 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.298736 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.298943 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.299034 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.299244 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.299342 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.299547 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.299725 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.299852 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.299951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.300155 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.300246 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.300456 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.300557 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.300756 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.300855 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.301065 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.301167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.301368 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.301461 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.301670 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.301760 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.301972 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.302071 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.302294 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.302402 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.302598 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.302690 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.302917 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.303014 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.303228 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.303329 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.303543 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.303678 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.303852 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.303956 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.304161 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.304259 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.304472 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.304566 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.304782 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.304898 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.305102 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.305194 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.305420 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.305510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.305726 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.305825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.306034 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.306123 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.306385 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.306489 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.306696 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.306806 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.307010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.307102 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.307322 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.307422 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.307634 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.307748 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.307947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.308051 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.308255 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.308357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.308554 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.308652 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.308794 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:33:15.308926 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.309188 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.309515 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.309837 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.310703 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.311022 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.311335 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.311665 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.311977 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.312290 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.312602 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.312914 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.313225 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.313541 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.313853 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.314165 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.314510 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.314828 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.315157 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.315480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.315793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.316118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.316444 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.316794 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.317108 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.317442 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.317771 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.318088 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.318422 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.318729 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:33:15.318971 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:33:15.374648 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO dbcounter [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] Registered counter for database nova_api Sep 01 16:33:15.380513 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO dbcounter [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] Registered counter for database nova_api Sep 01 16:33:15.397115 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_db.sqlalchemy.engines [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:33:15.401243 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_db.sqlalchemy.engines [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:33:15.404033 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writer thread running {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:33:15.407824 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writer thread running {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:33:15.460123 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.context [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9109a614-d982-4086-8e90-ca50e4acd6aa(cell1) {{(pid=127177) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 16:33:15.464102 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:15.464581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:15.465316 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.context [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9109a614-d982-4086-8e90-ca50e4acd6aa(cell1) {{(pid=127178) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 16:33:15.466269 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:15.466982 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:15.467669 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:15.469473 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:15.469682 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:15.469948 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:15.471561 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:15.471775 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO dbcounter [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] Registered counter for database nova_cell0 Sep 01 16:33:15.472426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:15.472882 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:15.474923 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:15.475933 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO dbcounter [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] Registered counter for database nova_cell1 Sep 01 16:33:15.476920 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO dbcounter [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] Registered counter for database nova_cell0 Sep 01 16:33:15.481011 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO dbcounter [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] Registered counter for database nova_cell1 Sep 01 16:33:15.483831 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_db.sqlalchemy.engines [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:33:15.488830 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writer thread running {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:33:15.492795 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_db.sqlalchemy.engines [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:33:15.493567 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_db.sqlalchemy.engines [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:33:15.501070 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writer thread running {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:33:15.503170 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writer thread running {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:33:15.632460 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_db.sqlalchemy.engines [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:33:15.637148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writer thread running {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:33:15.646544 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO dbcounter [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] Registered counter for database nova_cell0 Sep 01 16:33:15.650032 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO dbcounter [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] Registered counter for database nova_cell0 Sep 01 16:33:15.653302 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_db.sqlalchemy.engines [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:33:15.658024 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_db.sqlalchemy.engines [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:33:15.658323 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writer thread running {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:33:15.663540 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writer thread running {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:33:15.988842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: WARNING keystonemiddleware.auth_token [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:33:15.991905 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: WARNING keystonemiddleware.auth_token [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:33:15.996528 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: WARNING keystonemiddleware.auth_token [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:33:15.999836 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: WARNING keystonemiddleware.auth_token [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:33:16.347187 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: WARNING keystonemiddleware.auth_token [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:33:16.349658 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: WARNING keystonemiddleware.auth_token [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:33:16.353223 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: WARNING keystonemiddleware.auth_token [None req-93a51259-94af-4155-a5cf-6b177b0475e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:33:16.355689 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: WARNING keystonemiddleware.auth_token [None req-6497a24b-3482-481a-a184-5b702cb80324 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:33:16.358831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55593222e9c0 pid: 127178 (default app) Sep 01 16:33:16.361233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55593222e9c0 pid: 127177 (default app) Sep 01 16:33:52.722966 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=3 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:52.723765 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=3 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:52.724542 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=3 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:52.725381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=3 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:53.288016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-31ab03df-67f9-4d32-b2be-cbb505dd5434 tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] Calling method '.version_select at 0x7feeed24d3a0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:53.317596 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:53.318559 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:53.319386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:53.320718 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:54.302035 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-4e1709af-082b-4c97-870e-1652876e4cce tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Action: 'create', calling method: .version_select at 0x7feeed1a21f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-92497441"}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:54.312163 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-31ab03df-67f9-4d32-b2be-cbb505dd5434 tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cd1b4e1e-d9fb-42c6-b3a4-be9b3ff59fdf" status: 200 len: 351 microversion: 2.1 time: 1.325016 Sep 01 16:33:54.313241 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 1/1] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 1 16:33:52 2022] GET /compute/v2.1/os-volumes/cd1b4e1e-d9fb-42c6-b3a4-be9b3ff59fdf => generated 351 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:54.546081 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cc2ff2cd-367f-422b-ac7d-d14bb88867cf tempest-VolumesGetTestJSON-1795603215 tempest-VolumesGetTestJSON-1795603215-project] Action: 'create', calling method: .version_select at 0x7feeed06a160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1913898602", "metadata": {"Type": "work"}}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:55.719800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cc2ff2cd-367f-422b-ac7d-d14bb88867cf tempest-VolumesGetTestJSON-1795603215 tempest-VolumesGetTestJSON-1795603215-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.404264 Sep 01 16:33:55.721064 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 2/2] 10.222.0.18 () {60 vars in 1156 bytes} [Thu Sep 1 16:33:54 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1407 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 16:33:55.736459 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-152a2331-3ac2-4834-b842-9b3674c262fe tempest-VolumesGetTestJSON-1795603215 tempest-VolumesGetTestJSON-1795603215-project] Calling method '.version_select at 0x7feeed06ab80>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:55.932523 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-4e1709af-082b-4c97-870e-1652876e4cce tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 3.214562 Sep 01 16:33:55.934870 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1155 bytes} [Thu Sep 1 16:33:52 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 3218 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 16:33:55.942223 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-bfbbb322-dbc8-4d0c-8e04-fe7669968e90 tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] Calling method '.version_select at 0x7feeed0860d0>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:55.999029 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-152a2331-3ac2-4834-b842-9b3674c262fe tempest-VolumesGetTestJSON-1795603215 tempest-VolumesGetTestJSON-1795603215-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1ac01e46-8be0-4979-b1bb-47d5b83ac98f" status: 200 len: 353 microversion: 2.1 time: 0.266965 Sep 01 16:33:55.999591 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 3/4] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 1 16:33:55 2022] GET /compute/v2.1/os-volumes/1ac01e46-8be0-4979-b1bb-47d5b83ac98f => generated 353 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:56.005355 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0cb326c8-5e3a-44bf-a710-1e4d12fd0ebb tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeed06a3a0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:56.062992 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-bfbbb322-dbc8-4d0c-8e04-fe7669968e90 tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/151674f1-f798-4a53-aa8d-7e6188a3aca4" status: 200 len: 351 microversion: 2.1 time: 0.126218 Sep 01 16:33:56.064451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 2/5] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 1 16:33:55 2022] GET /compute/v2.1/os-volumes/151674f1-f798-4a53-aa8d-7e6188a3aca4 => generated 351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:56.135170 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0cb326c8-5e3a-44bf-a710-1e4d12fd0ebb tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8f583dc2-5dca-450d-b54c-c0c8f63d8b61" status: 200 len: 343 microversion: 2.1 time: 0.134178 Sep 01 16:33:56.135870 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 4/6] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 1 16:33:55 2022] GET /compute/v2.1/os-volumes/8f583dc2-5dca-450d-b54c-c0c8f63d8b61 => generated 343 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:57.014268 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-3b32f561-04de-4835-a022-fa005338d3ff tempest-VolumesGetTestJSON-1795603215 tempest-VolumesGetTestJSON-1795603215-project] Calling method '.version_select at 0x7feeed086820>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:57.109552 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-3b32f561-04de-4835-a022-fa005338d3ff tempest-VolumesGetTestJSON-1795603215 tempest-VolumesGetTestJSON-1795603215-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1ac01e46-8be0-4979-b1bb-47d5b83ac98f" status: 200 len: 354 microversion: 2.1 time: 0.099982 Sep 01 16:33:57.117788 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 3/7] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 1 16:33:57 2022] GET /compute/v2.1/os-volumes/1ac01e46-8be0-4979-b1bb-47d5b83ac98f => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:33:57.124431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2df26f43-c2fd-4ce2-8e94-5fd831ff2673 tempest-VolumesGetTestJSON-1795603215 tempest-VolumesGetTestJSON-1795603215-project] Calling method '.version_select at 0x7feeed08b160>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:57.148720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-04f155da-4d28-4216-860a-e31a26c5a5c8 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeed086f70>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:57.229174 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2df26f43-c2fd-4ce2-8e94-5fd831ff2673 tempest-VolumesGetTestJSON-1795603215 tempest-VolumesGetTestJSON-1795603215-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1ac01e46-8be0-4979-b1bb-47d5b83ac98f" status: 200 len: 354 microversion: 2.1 time: 0.109051 Sep 01 16:33:57.229738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 5/8] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 1 16:33:57 2022] GET /compute/v2.1/os-volumes/1ac01e46-8be0-4979-b1bb-47d5b83ac98f => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:57.238350 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-04f155da-4d28-4216-860a-e31a26c5a5c8 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8f583dc2-5dca-450d-b54c-c0c8f63d8b61" status: 200 len: 344 microversion: 2.1 time: 0.092716 Sep 01 16:33:57.239716 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 4/9] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 1 16:33:57 2022] GET /compute/v2.1/os-volumes/8f583dc2-5dca-450d-b54c-c0c8f63d8b61 => generated 344 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:33:57.243389 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6561040a-74bb-45a3-8367-6ed5e396c673 tempest-VolumesGetTestJSON-1795603215 tempest-VolumesGetTestJSON-1795603215-project] Calling method '.version_select at 0x7feeed06ad30>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:57.252686 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-74b0267a-8e79-46c7-b653-6b096ab45c3b tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Action: 'create', calling method: .version_select at 0x7feeed086b80>, body: {"snapshot": {"volume_id": "8f583dc2-5dca-450d-b54c-c0c8f63d8b61", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-895101656"}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:57.375589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6561040a-74bb-45a3-8367-6ed5e396c673 tempest-VolumesGetTestJSON-1795603215 tempest-VolumesGetTestJSON-1795603215-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/1ac01e46-8be0-4979-b1bb-47d5b83ac98f" status: 202 len: 0 microversion: 2.1 time: 0.135915 Sep 01 16:33:57.376687 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 6/10] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 1 16:33:57 2022] DELETE /compute/v2.1/os-volumes/1ac01e46-8be0-4979-b1bb-47d5b83ac98f => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:33:57.385339 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0552a1fb-7562-46ac-aab9-4484ddf6d334 tempest-VolumesGetTestJSON-1795603215 tempest-VolumesGetTestJSON-1795603215-project] Calling method '.version_select at 0x7feeed06a8b0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:57.449175 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0552a1fb-7562-46ac-aab9-4484ddf6d334 tempest-VolumesGetTestJSON-1795603215 tempest-VolumesGetTestJSON-1795603215-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1ac01e46-8be0-4979-b1bb-47d5b83ac98f" status: 200 len: 353 microversion: 2.1 time: 0.067758 Sep 01 16:33:57.450455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 7/11] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 1 16:33:57 2022] GET /compute/v2.1/os-volumes/1ac01e46-8be0-4979-b1bb-47d5b83ac98f => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:57.721846 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-74b0267a-8e79-46c7-b653-6b096ab45c3b tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.473097 Sep 01 16:33:57.728339 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 5/12] 10.222.0.18 () {60 vars in 1162 bytes} [Thu Sep 1 16:33:57 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:57.734932 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-eb34d226-942f-4f8b-bd96-a1e4826c51e4 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeed08b4c0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:57.815191 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-eb34d226-942f-4f8b-bd96-a1e4826c51e4 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd" status: 200 len: 286 microversion: 2.1 time: 0.085471 Sep 01 16:33:57.816136 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 8/13] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 1 16:33:57 2022] GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:57.826500 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a35fbbf1-2da0-41ba-9e4f-a6bea15a3404 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeed0131f0>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:57.960735 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2393aa9b-ac20-4d5f-a7be-1d8a5aee4509 tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] Calling method '.version_select at 0x7feeed06ab80>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:58.037395 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a35fbbf1-2da0-41ba-9e4f-a6bea15a3404 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.214750 Sep 01 16:33:58.050112 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 6/14] 10.222.0.18 () {58 vars in 1140 bytes} [Thu Sep 1 16:33:57 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:58.058162 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-234fa6b3-095f-48c9-92b5-6314ef6cc985 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeed0139d0>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:58.107040 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2393aa9b-ac20-4d5f-a7be-1d8a5aee4509 tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/50493c23-4aca-478c-8c0d-7cccff61ff5f" status: 200 len: 351 microversion: 2.1 time: 0.154008 Sep 01 16:33:58.107691 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 9/15] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 1 16:33:57 2022] GET /compute/v2.1/os-volumes/50493c23-4aca-478c-8c0d-7cccff61ff5f => generated 351 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:58.122605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-78a75c69-153d-4092-801d-c1f986c684bf tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] Calling method '.version_select at 0x7feeed06a3a0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:58.264363 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-234fa6b3-095f-48c9-92b5-6314ef6cc985 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd" status: 200 len: 286 microversion: 2.1 time: 0.212717 Sep 01 16:33:58.264997 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 7/16] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 1 16:33:58 2022] GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd => generated 286 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:58.452635 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-78a75c69-153d-4092-801d-c1f986c684bf tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.333695 Sep 01 16:33:58.453977 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 10/17] 10.222.0.18 () {58 vars in 1134 bytes} [Thu Sep 1 16:33:58 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:58.465947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-5efed122-edd0-4d9c-8722-6e9e76e99063 tempest-VolumesGetTestJSON-1795603215 tempest-VolumesGetTestJSON-1795603215-project] Calling method '.version_select at 0x7feeed0134c0>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:58.472997 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8efd3197-c7f5-421e-8ecb-cc518c8beb1d tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] Calling method '.version_select at 0x7feeed08b9d0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:58.525500 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-5efed122-edd0-4d9c-8722-6e9e76e99063 tempest-VolumesGetTestJSON-1795603215 tempest-VolumesGetTestJSON-1795603215-project] HTTP exception thrown: Volume 1ac01e46-8be0-4979-b1bb-47d5b83ac98f could not be found. Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-5efed122-edd0-4d9c-8722-6e9e76e99063 tempest-VolumesGetTestJSON-1795603215 tempest-VolumesGetTestJSON-1795603215-project] Request method failure captured: Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/os-volumes/1ac01e46-8be0-4979-b1bb-47d5b83ac98f HTTP/1.1 Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN7xRu20PBTq5Nd8DmkD5V7XA4jQdGsrWB9a9r4T5367cYmIVhoMWfeRgpl1_HKW2r-qg45_AJ6YKhpTxWalrPXltDmFi79krw9jxdQJzKHf-VwHam0XTkbQTMHOBd_XOnYbYKvgPu_2OYArolCcWiQNCLxJ2762CxoHdE4ABXbi7o4 Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: 66f2b3d1b1dc464f8e0501519f3b211e Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-VolumesGetTestJSON-1795603215 Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:33:58.530518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:33:58.531650 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/66f2b3d1b1dc464f8e0501519f3b211e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_66f2b3d1b1dc464f8e0501519f3b211e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66f2b3d1b1dc464f8e0501519f3b211e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/66f2b3d1b1dc464f8e0501519f3b211e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:33:58.531650 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-VolumesGetTestJSON-1795603215 Sep 01 16:33:58.531650 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: 66f2b3d1b1dc464f8e0501519f3b211e Sep 01 16:33:58.531650 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-VolumesGetTestJSON-1795603215 Sep 01 16:33:58.531650 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-VolumesGetTestJSON-1795603215-project Sep 01 16:33:58.531650 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:33:58.531650 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:33:58.531650 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: ec2654278e1f4717aa7f49f3f9c73504 Sep 01 16:33:58.531650 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-VolumesGetTestJSON-1795603215-project Sep 01 16:33:58.531650 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: Sep 01 16:33:58.531650 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Volume 1ac01e46-8be0-4979-b1bb-47d5b83ac98f could not be found. Sep 01 16:33:58.531650 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': '1ac01e46-8be0-4979-b1bb-47d5b83ac98f'} Sep 01 16:33:58.531650 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1ac01e46-8be0-4979-b1bb-47d5b83ac98f could not be found. (HTTP 404) (Request-ID: req-7186af58-f854-48bd-9641-5b3501cd7c4e) Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:33:58.532455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:33:58.533356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1ac01e46-8be0-4979-b1bb-47d5b83ac98f could not be found. Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 16:33:58.534228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:33:58.535144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1ac01e46-8be0-4979-b1bb-47d5b83ac98f could not be found. Sep 01 16:33:58.535144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:33:58.535144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:33:58.535144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:33:58.535144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:58.535144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:33:58.535144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:33:58.535144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:33:58.535144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:33:58.535144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1ac01e46-8be0-4979-b1bb-47d5b83ac98f could not be found. Sep 01 16:33:58.535144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:33:58.537826 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-5efed122-edd0-4d9c-8722-6e9e76e99063 tempest-VolumesGetTestJSON-1795603215 tempest-VolumesGetTestJSON-1795603215-project] Returning 404 to user: Volume 1ac01e46-8be0-4979-b1bb-47d5b83ac98f could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:33:58.538906 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-5efed122-edd0-4d9c-8722-6e9e76e99063 tempest-VolumesGetTestJSON-1795603215 tempest-VolumesGetTestJSON-1795603215-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1ac01e46-8be0-4979-b1bb-47d5b83ac98f" status: 404 len: 109 microversion: 2.1 time: 0.078855 Sep 01 16:33:58.540988 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 8/18] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 1 16:33:58 2022] GET /compute/v2.1/os-volumes/1ac01e46-8be0-4979-b1bb-47d5b83ac98f => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:33:58.732324 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8efd3197-c7f5-421e-8ecb-cc518c8beb1d tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.262950 Sep 01 16:33:58.733004 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 11/19] 10.222.0.18 () {58 vars in 1149 bytes} [Thu Sep 1 16:33:58 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:58.747846 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6cc55e46-8c03-4645-bd27-27cb0c1f446b tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] Calling method '.version_select at 0x7feeed086a60>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:58.967095 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-6cc55e46-8c03-4645-bd27-27cb0c1f446b tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.224167 Sep 01 16:33:58.975420 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 9/20] 10.222.0.18 () {58 vars in 1134 bytes} [Thu Sep 1 16:33:58 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:58.982586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f41b782a-880a-42ad-be57-18e9e0de99a0 tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] Calling method '.version_select at 0x7feeed08b940>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:59.186495 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f41b782a-880a-42ad-be57-18e9e0de99a0 tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.209600 Sep 01 16:33:59.187210 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 12/21] 10.222.0.18 () {58 vars in 1167 bytes} [Thu Sep 1 16:33:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:59.200847 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f18daf52-993c-421b-b4c6-de70f86e5182 tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] Calling method '.version_select at 0x7feeecff8af0>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:59.276873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e12b6316-67ce-4ac4-9e6f-c9b7d996f064 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeed06ad30>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:59.326873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e12b6316-67ce-4ac4-9e6f-c9b7d996f064 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd" status: 200 len: 286 microversion: 2.1 time: 0.053568 Sep 01 16:33:59.327708 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 13/22] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 1 16:33:59 2022] GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:59.333951 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f18daf52-993c-421b-b4c6-de70f86e5182 tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.137249 Sep 01 16:33:59.334538 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 10/23] 10.222.0.18 () {58 vars in 1170 bytes} [Thu Sep 1 16:33:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:59.347403 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-29a9c80f-6043-44fc-bb34-849ff2ffe470 tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] Calling method '.version_select at 0x7feeed06a9d0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:59.480305 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-29a9c80f-6043-44fc-bb34-849ff2ffe470 tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.136606 Sep 01 16:33:59.483225 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 14/24] 10.222.0.18 () {58 vars in 1155 bytes} [Thu Sep 1 16:33:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:59.495893 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e7bc588f-b5e0-4353-8cfe-0a13f84fb665 tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] Calling method '.version_select at 0x7feeecff8940>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:59.583424 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-e7bc588f-b5e0-4353-8cfe-0a13f84fb665 tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091220 Sep 01 16:33:59.597619 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a7fc8bee-fb5c-49a7-8dfa-ea83f3c29f94 tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] Calling method '.version_select at 0x7feeed06a8b0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:59.597829 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 11/25] 10.222.0.18 () {58 vars in 1188 bytes} [Thu Sep 1 16:33:59 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:59.712907 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a7fc8bee-fb5c-49a7-8dfa-ea83f3c29f94 tempest-VolumesTestJSON-1669450727 tempest-VolumesTestJSON-1669450727-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.118948 Sep 01 16:33:59.713619 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 15/26] 10.222.0.18 () {58 vars in 1155 bytes} [Thu Sep 1 16:33:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:00.340676 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-8fd075a3-152b-41a0-bd61-cc0d71e6b999 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeed086b80>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:00.410118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-8fd075a3-152b-41a0-bd61-cc0d71e6b999 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd" status: 200 len: 286 microversion: 2.1 time: 0.070457 Sep 01 16:34:00.415618 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 12/27] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 1 16:34:00 2022] GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:01.422020 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-05dfb81c-e746-4dfd-9990-4c2465a689c5 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeed08b820>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:01.464912 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-05dfb81c-e746-4dfd-9990-4c2465a689c5 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd" status: 200 len: 287 microversion: 2.1 time: 0.046691 Sep 01 16:34:01.466265 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 16/28] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 1 16:34:01 2022] GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:01.477435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-53500ba9-05c1-475a-b144-d01d52e2c655 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeed006310>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:01.570495 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-53500ba9-05c1-475a-b144-d01d52e2c655 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd" status: 202 len: 0 microversion: 2.1 time: 0.096962 Sep 01 16:34:01.576140 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 13/29] 10.222.0.18 () {58 vars in 1254 bytes} [Thu Sep 1 16:34:01 2022] DELETE /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:34:01.580385 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-060d2cf1-b822-4ccf-b4a6-6ddb57521b1f tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeed08b040>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:01.632121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-060d2cf1-b822-4ccf-b4a6-6ddb57521b1f tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd" status: 200 len: 286 microversion: 2.1 time: 0.056087 Sep 01 16:34:01.639268 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 17/30] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 1 16:34:01 2022] GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:34:02.644891 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-32e870af-f908-4b4e-9cc5-4cd105ffabab tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeed086550>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:02.703794 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-32e870af-f908-4b4e-9cc5-4cd105ffabab tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd" status: 200 len: 286 microversion: 2.1 time: 0.062601 Sep 01 16:34:02.709084 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 14/31] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 1 16:34:02 2022] GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:03.690520 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1132c563-4e92-44a8-bd36-ff8e66331a31 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Action: 'create', calling method: .version_select at 0x7feeed08b8b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1642503413", "metadata": {"Type": "work"}}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1132c563-4e92-44a8-bd36-ff8e66331a31 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Request method failure captured: Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 122 Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN77hIw2-adOztAZfAH7dgMAUWbx4KLIryTQc2_yTQPbQnZJCjYM54rqMHV9mcMgpcxGf6P7ZZ9KbYTzix2HZTGrxrbBhPp1VAWPAcMFEiMjKTouGUeqdNEUSlUlgGsNio50ru1z7JL8W_xgL0G5mAMXyr1TY8o-Qp4jCx2hSH5Ln54 Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 937e87b0003d435281e7611179947b99 Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:34:03.698740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:34:03.700608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/937e87b0003d435281e7611179947b99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_937e87b0003d435281e7611179947b99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/937e87b0003d435281e7611179947b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/937e87b0003d435281e7611179947b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:34:03.700608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:03.700608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 937e87b0003d435281e7611179947b99 Sep 01 16:34:03.700608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:03.700608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesNegativeTest-1666615879-project Sep 01 16:34:03.700608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:34:03.700608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:34:03.700608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: dcb69d9d9ad44f409116a3c0737eb466 Sep 01 16:34:03.700608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesNegativeTest-1666615879-project Sep 01 16:34:03.700608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Sep 01 16:34:03.700608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1642503413", "metadata": {"Type": "work"}}} Sep 01 16:34:03.700608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: Sep 01 16:34:03.700608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1642503413', 'metadata': {'Type': 'work'}}}} Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise error Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:34:03.701307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 16:34:03.702406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 16:34:03.706079 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 16:34:03.706079 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.709115 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1132c563-4e92-44a8-bd36-ff8e66331a31 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:34:03.718585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-9c3e320b-923f-4bc9-bf5d-3dd505bb4b4d tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeecff8d30>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:03.739411 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1132c563-4e92-44a8-bd36-ff8e66331a31 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.337485 Sep 01 16:34:03.743959 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 18/32] 10.222.0.18 () {60 vars in 1156 bytes} [Thu Sep 1 16:34:03 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 343 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:34:03.749607 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f0c98e7b-4e56-4939-945c-31a6a0938365 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Action: 'create', calling method: .version_select at 0x7feeed06a8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1074391930", "metadata": {"Type": "work"}}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f0c98e7b-4e56-4939-945c-31a6a0938365 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Request method failure captured: Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 120 Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN77hIw2-adOztAZfAH7dgMAUWbx4KLIryTQc2_yTQPbQnZJCjYM54rqMHV9mcMgpcxGf6P7ZZ9KbYTzix2HZTGrxrbBhPp1VAWPAcMFEiMjKTouGUeqdNEUSlUlgGsNio50ru1z7JL8W_xgL0G5mAMXyr1TY8o-Qp4jCx2hSH5Ln54 Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 937e87b0003d435281e7611179947b99 Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:34:03.795227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:34:03.796510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/937e87b0003d435281e7611179947b99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_937e87b0003d435281e7611179947b99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/937e87b0003d435281e7611179947b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/937e87b0003d435281e7611179947b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:34:03.796510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:03.796510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 937e87b0003d435281e7611179947b99 Sep 01 16:34:03.796510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:03.796510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesNegativeTest-1666615879-project Sep 01 16:34:03.796510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:34:03.796510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:34:03.796510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: dcb69d9d9ad44f409116a3c0737eb466 Sep 01 16:34:03.796510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesNegativeTest-1666615879-project Sep 01 16:34:03.796510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Sep 01 16:34:03.796510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1074391930", "metadata": {"Type": "work"}}} Sep 01 16:34:03.796510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: Sep 01 16:34:03.796510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1074391930', 'metadata': {'Type': 'work'}}}} Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise error Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi '0' Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:34:03.797204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 16:34:03.798257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 16:34:03.799158 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 16:34:03.799158 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.799282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-9c3e320b-923f-4bc9-bf5d-3dd505bb4b4d tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd" status: 200 len: 286 microversion: 2.1 time: 0.082511 Sep 01 16:34:03.799356 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f0c98e7b-4e56-4939-945c-31a6a0938365 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:34:03.799356 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f0c98e7b-4e56-4939-945c-31a6a0938365 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.051172 Sep 01 16:34:03.801099 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 15/33] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 1 16:34:03 2022] GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:03.803324 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 19/34] 10.222.0.18 () {60 vars in 1156 bytes} [Thu Sep 1 16:34:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:34:03.808008 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d5f1017a-4e90-4407-8cdb-e99cfcc120f6 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Action: 'create', calling method: .version_select at 0x7feeecff8160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-581599083", "metadata": {"Type": "work"}}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d5f1017a-4e90-4407-8cdb-e99cfcc120f6 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Request method failure captured: Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 118 Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN77hIw2-adOztAZfAH7dgMAUWbx4KLIryTQc2_yTQPbQnZJCjYM54rqMHV9mcMgpcxGf6P7ZZ9KbYTzix2HZTGrxrbBhPp1VAWPAcMFEiMjKTouGUeqdNEUSlUlgGsNio50ru1z7JL8W_xgL0G5mAMXyr1TY8o-Qp4jCx2hSH5Ln54 Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: 937e87b0003d435281e7611179947b99 Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:34:03.816110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:34:03.817435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/937e87b0003d435281e7611179947b99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_937e87b0003d435281e7611179947b99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/937e87b0003d435281e7611179947b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/937e87b0003d435281e7611179947b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:34:03.817435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:03.817435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: 937e87b0003d435281e7611179947b99 Sep 01 16:34:03.817435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:03.817435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-VolumesNegativeTest-1666615879-project Sep 01 16:34:03.817435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:34:03.817435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:34:03.817435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: dcb69d9d9ad44f409116a3c0737eb466 Sep 01 16:34:03.817435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-VolumesNegativeTest-1666615879-project Sep 01 16:34:03.817435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Sep 01 16:34:03.817435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-581599083", "metadata": {"Type": "work"}}} Sep 01 16:34:03.817435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: Sep 01 16:34:03.817435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-581599083', 'metadata': {'Type': 'work'}}}} Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise error Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi '' Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:34:03.818209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 16:34:03.819479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 16:34:03.820528 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 16:34:03.820528 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.821672 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d5f1017a-4e90-4407-8cdb-e99cfcc120f6 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:34:03.822861 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d5f1017a-4e90-4407-8cdb-e99cfcc120f6 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018503 Sep 01 16:34:03.823998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 16/35] 10.222.0.18 () {60 vars in 1156 bytes} [Thu Sep 1 16:34:03 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:34:03.835307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-927f46d9-e863-411f-8214-51785da3559b tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Calling method '.version_select at 0x7feeed9e34c0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:03.885661 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-927f46d9-e863-411f-8214-51785da3559b tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] HTTP exception thrown: Volume tempest-invalid-48416851 could not be found. Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-927f46d9-e863-411f-8214-51785da3559b tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Request method failure captured: Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-48416851 HTTP/1.1 Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN77hIw2-adOztAZfAH7dgMAUWbx4KLIryTQc2_yTQPbQnZJCjYM54rqMHV9mcMgpcxGf6P7ZZ9KbYTzix2HZTGrxrbBhPp1VAWPAcMFEiMjKTouGUeqdNEUSlUlgGsNio50ru1z7JL8W_xgL0G5mAMXyr1TY8o-Qp4jCx2hSH5Ln54 Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 937e87b0003d435281e7611179947b99 Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:34:03.889822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:34:03.891148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/937e87b0003d435281e7611179947b99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_937e87b0003d435281e7611179947b99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/937e87b0003d435281e7611179947b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/937e87b0003d435281e7611179947b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:34:03.891148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:03.891148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 937e87b0003d435281e7611179947b99 Sep 01 16:34:03.891148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:03.891148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesNegativeTest-1666615879-project Sep 01 16:34:03.891148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:34:03.891148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:34:03.891148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: dcb69d9d9ad44f409116a3c0737eb466 Sep 01 16:34:03.891148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesNegativeTest-1666615879-project Sep 01 16:34:03.891148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: Sep 01 16:34:03.891148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Volume tempest-invalid-48416851 could not be found. Sep 01 16:34:03.891148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': 'tempest-invalid-48416851'} Sep 01 16:34:03.891148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-48416851 could not be found. (HTTP 404) (Request-ID: req-9c93e167-5bf7-4aa3-a122-be337a46d86f) Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:03.891940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:34:03.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-48416851 could not be found. Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:34:03.894508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-48416851 could not be found. Sep 01 16:34:03.895954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.895954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:03.895954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.895954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:03.895954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:03.895954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:03.895954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:34:03.895954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:34:03.895954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-48416851 could not be found. Sep 01 16:34:03.895954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:03.895954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-927f46d9-e863-411f-8214-51785da3559b tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Returning 404 to user: Volume tempest-invalid-48416851 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:34:03.895954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-927f46d9-e863-411f-8214-51785da3559b tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-48416851" status: 404 len: 97 microversion: 2.1 time: 0.060527 Sep 01 16:34:03.903300 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-96c3e3bb-2d19-4140-ac90-0634b8b6dfbd tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004379 Sep 01 16:34:03.903824 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 17/37] 10.222.0.18 () {58 vars in 1140 bytes} [Thu Sep 1 16:34:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 16:34:03.918065 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 20/37] 10.222.0.18 () {58 vars in 1212 bytes} [Thu Sep 1 16:34:03 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-48416851 => generated 97 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 16:34:03.921278 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-5d1b6f67-fdb4-417d-ba14-6b4f731dc947 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005995 Sep 01 16:34:03.935854 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-610316d0-aa0a-4dee-bcac-0fe2f6a13d3b tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Calling method '.version_select at 0x7feeed06a3a0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:03.938593 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 18/38] 10.222.0.18 () {58 vars in 1137 bytes} [Thu Sep 1 16:34:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 16:34:04.000116 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-610316d0-aa0a-4dee-bcac-0fe2f6a13d3b tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] HTTP exception thrown: Volume f8987adc-583e-440e-949b-728aa2f9c74f could not be found. Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-610316d0-aa0a-4dee-bcac-0fe2f6a13d3b tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Request method failure captured: Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: DELETE /compute/v2.1/os-volumes/f8987adc-583e-440e-949b-728aa2f9c74f HTTP/1.1 Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN77hIw2-adOztAZfAH7dgMAUWbx4KLIryTQc2_yTQPbQnZJCjYM54rqMHV9mcMgpcxGf6P7ZZ9KbYTzix2HZTGrxrbBhPp1VAWPAcMFEiMjKTouGUeqdNEUSlUlgGsNio50ru1z7JL8W_xgL0G5mAMXyr1TY8o-Qp4jCx2hSH5Ln54 Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 937e87b0003d435281e7611179947b99 Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:34:04.002056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:34:04.003182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/937e87b0003d435281e7611179947b99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_937e87b0003d435281e7611179947b99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/937e87b0003d435281e7611179947b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/937e87b0003d435281e7611179947b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:34:04.003182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:04.003182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 937e87b0003d435281e7611179947b99 Sep 01 16:34:04.003182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:04.003182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesNegativeTest-1666615879-project Sep 01 16:34:04.003182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:34:04.003182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:34:04.003182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: dcb69d9d9ad44f409116a3c0737eb466 Sep 01 16:34:04.003182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesNegativeTest-1666615879-project Sep 01 16:34:04.003182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: Sep 01 16:34:04.003182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Volume f8987adc-583e-440e-949b-728aa2f9c74f could not be found. Sep 01 16:34:04.003182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': 'f8987adc-583e-440e-949b-728aa2f9c74f'} Sep 01 16:34:04.003182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f8987adc-583e-440e-949b-728aa2f9c74f could not be found. (HTTP 404) (Request-ID: req-9e037387-c251-4bcb-a7ef-943ce1b57fc6) Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:04.003800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:34:04.004677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f8987adc-583e-440e-949b-728aa2f9c74f could not be found. Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 16:34:04.005523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:34:04.006393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f8987adc-583e-440e-949b-728aa2f9c74f could not be found. Sep 01 16:34:04.006393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.006393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:04.006393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.006393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:04.006393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:04.006393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:04.006393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:34:04.006393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:34:04.006393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f8987adc-583e-440e-949b-728aa2f9c74f could not be found. Sep 01 16:34:04.006393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.006393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-610316d0-aa0a-4dee-bcac-0fe2f6a13d3b tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Returning 404 to user: Volume f8987adc-583e-440e-949b-728aa2f9c74f could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:34:04.006393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-610316d0-aa0a-4dee-bcac-0fe2f6a13d3b tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/f8987adc-583e-440e-949b-728aa2f9c74f" status: 404 len: 109 microversion: 2.1 time: 0.072560 Sep 01 16:34:04.006393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 21/39] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 1 16:34:03 2022] DELETE /compute/v2.1/os-volumes/f8987adc-583e-440e-949b-728aa2f9c74f => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:34:04.015007 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-881beb26-0040-47fd-97a1-ab5384088451 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Calling method '.version_select at 0x7feeecff8e50>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:04.089287 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-881beb26-0040-47fd-97a1-ab5384088451 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] HTTP exception thrown: Volume 2440e70b-8ff0-43f4-9395-c621a8608a61 could not be found. Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-881beb26-0040-47fd-97a1-ab5384088451 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Request method failure captured: Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/os-volumes/2440e70b-8ff0-43f4-9395-c621a8608a61 HTTP/1.1 Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN77hIw2-adOztAZfAH7dgMAUWbx4KLIryTQc2_yTQPbQnZJCjYM54rqMHV9mcMgpcxGf6P7ZZ9KbYTzix2HZTGrxrbBhPp1VAWPAcMFEiMjKTouGUeqdNEUSlUlgGsNio50ru1z7JL8W_xgL0G5mAMXyr1TY8o-Qp4jCx2hSH5Ln54 Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: 937e87b0003d435281e7611179947b99 Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:34:04.091493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:34:04.092831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/937e87b0003d435281e7611179947b99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_937e87b0003d435281e7611179947b99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/937e87b0003d435281e7611179947b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/937e87b0003d435281e7611179947b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:34:04.092831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:04.092831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: 937e87b0003d435281e7611179947b99 Sep 01 16:34:04.092831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-VolumesNegativeTest-1666615879 Sep 01 16:34:04.092831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-VolumesNegativeTest-1666615879-project Sep 01 16:34:04.092831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:34:04.092831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:34:04.092831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: dcb69d9d9ad44f409116a3c0737eb466 Sep 01 16:34:04.092831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-VolumesNegativeTest-1666615879-project Sep 01 16:34:04.092831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: Sep 01 16:34:04.092831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Volume 2440e70b-8ff0-43f4-9395-c621a8608a61 could not be found. Sep 01 16:34:04.092831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': '2440e70b-8ff0-43f4-9395-c621a8608a61'} Sep 01 16:34:04.092831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2440e70b-8ff0-43f4-9395-c621a8608a61 could not be found. (HTTP 404) (Request-ID: req-89c865ab-d081-4130-8a20-7929c36a8223) Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:04.093595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:34:04.094733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2440e70b-8ff0-43f4-9395-c621a8608a61 could not be found. Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 16:34:04.095730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:34:04.097002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2440e70b-8ff0-43f4-9395-c621a8608a61 could not be found. Sep 01 16:34:04.097002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.097002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:04.097002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.097002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:04.097002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:04.097002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:04.097002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:34:04.097002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:34:04.097002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2440e70b-8ff0-43f4-9395-c621a8608a61 could not be found. Sep 01 16:34:04.097002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.097002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-881beb26-0040-47fd-97a1-ab5384088451 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] Returning 404 to user: Volume 2440e70b-8ff0-43f4-9395-c621a8608a61 could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:34:04.097002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-881beb26-0040-47fd-97a1-ab5384088451 tempest-VolumesNegativeTest-1666615879 tempest-VolumesNegativeTest-1666615879-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/2440e70b-8ff0-43f4-9395-c621a8608a61" status: 404 len: 109 microversion: 2.1 time: 0.081845 Sep 01 16:34:04.103403 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 19/40] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 1 16:34:04 2022] GET /compute/v2.1/os-volumes/2440e70b-8ff0-43f4-9395-c621a8608a61 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:34:04.808275 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f6c6f871-a58c-40ff-b354-e5f0d89e37c5 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeecf9c700>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:04.873191 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-f6c6f871-a58c-40ff-b354-e5f0d89e37c5 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] HTTP exception thrown: Snapshot bc4a351b-149c-4c56-aeb6-2d46f7271fdd could not be found. Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f6c6f871-a58c-40ff-b354-e5f0d89e37c5 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Request method failure captured: Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd HTTP/1.1 Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN7wIRhryxxW01CAm2HKgBCby3tQ3xNF9webyPQkLVO8Ovr0RbB10RufJk4pwlUjRzpz0ksjCSjUOq9asgLDq8f5TVazvW-WmzIX4lPMu0NSIPmb0fjmwNPwfxZRSbcgi971_L7tS4t61hEh--8FieOjFNk1NWK3OrBv4NxgxWvi3CE Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 170a066ef9584da0915a40ff4379c985 Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1030101819 Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:34:04.875871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:34:04.876929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/170a066ef9584da0915a40ff4379c985"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_170a066ef9584da0915a40ff4379c985"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/170a066ef9584da0915a40ff4379c985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/170a066ef9584da0915a40ff4379c985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:34:04.876929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1030101819 Sep 01 16:34:04.876929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 170a066ef9584da0915a40ff4379c985 Sep 01 16:34:04.876929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1030101819 Sep 01 16:34:04.876929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesSnapshotsTestJSON-1030101819-project Sep 01 16:34:04.876929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:34:04.876929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:34:04.876929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: d5e7228941074b579d0b11334226169c Sep 01 16:34:04.876929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1030101819-project Sep 01 16:34:04.876929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: Sep 01 16:34:04.876929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Snapshot bc4a351b-149c-4c56-aeb6-2d46f7271fdd could not be found. Sep 01 16:34:04.876929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': 'bc4a351b-149c-4c56-aeb6-2d46f7271fdd'} Sep 01 16:34:04.876929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bc4a351b-149c-4c56-aeb6-2d46f7271fdd could not be found. (HTTP 404) (Request-ID: req-f0e6ca03-045f-4c7e-9392-3dfafb1b0061) Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.877589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:34:04.878545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bc4a351b-149c-4c56-aeb6-2d46f7271fdd could not be found. Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 16:34:04.879451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:34:04.881066 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bc4a351b-149c-4c56-aeb6-2d46f7271fdd could not be found. Sep 01 16:34:04.881066 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.881066 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:04.881066 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.881066 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:04.881066 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:04.881066 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:04.881066 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:34:04.881066 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:34:04.881066 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bc4a351b-149c-4c56-aeb6-2d46f7271fdd could not be found. Sep 01 16:34:04.881066 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:04.887704 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f6c6f871-a58c-40ff-b354-e5f0d89e37c5 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Returning 404 to user: Snapshot bc4a351b-149c-4c56-aeb6-2d46f7271fdd could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:34:04.888626 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f6c6f871-a58c-40ff-b354-e5f0d89e37c5 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd" status: 404 len: 111 microversion: 2.1 time: 0.084484 Sep 01 16:34:04.889185 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 22/41] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 1 16:34:04 2022] GET /compute/v2.1/os-snapshots/bc4a351b-149c-4c56-aeb6-2d46f7271fdd => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:34:04.899384 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ea77711a-3f47-4a27-8f67-cd4ea8e3c064 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeecf9cca0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:05.062581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ea77711a-3f47-4a27-8f67-cd4ea8e3c064 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/8f583dc2-5dca-450d-b54c-c0c8f63d8b61" status: 202 len: 0 microversion: 2.1 time: 0.166823 Sep 01 16:34:05.063614 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 23/42] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 1 16:34:04 2022] DELETE /compute/v2.1/os-volumes/8f583dc2-5dca-450d-b54c-c0c8f63d8b61 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:34:05.071850 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-18096fa5-3966-4f84-b0a0-d0137596a3f1 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeecf9c040>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:05.180293 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-18096fa5-3966-4f84-b0a0-d0137596a3f1 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8f583dc2-5dca-450d-b54c-c0c8f63d8b61" status: 200 len: 343 microversion: 2.1 time: 0.112437 Sep 01 16:34:05.180961 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 24/43] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 1 16:34:05 2022] GET /compute/v2.1/os-volumes/8f583dc2-5dca-450d-b54c-c0c8f63d8b61 => generated 343 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:34:05.214437 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-457674321", "imageRef": "46185d58-0d47-4c97-b590-0f4434aa5c9e", "flavorRef": "452", "networks": [{"uuid": "dca0ab61-d5ff-4379-b762-3829795267ff"}]}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:05.468002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.network.neutron [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] validate_networks() for [('dca0ab61-d5ff-4379-b762-3829795267ff', None, None, None, None, None)] {{(pid=127178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:34:06.224817 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-52691bc6-e988-43e2-b544-40f6c2917190 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Action: 'create', calling method: .version_select at 0x7feeecfae0d0>, body: {"keypair": {"name": "tempest-keypair-1154839340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMTOn5AoUIugey0GVik0JzMfq+9LESFcA2Y237lejDJ1+HZ+ckduHnNvDptXAZKXlNoiiY32ESF2ABL1chWkbRA/gthxz0lNdrdQLWTdzdQNgGyHJ4ip+LmGpBt85kByw=="}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:06.501623 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-52691bc6-e988-43e2-b544-40f6c2917190 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Getting quotas for project cfb0b630e22745e8af15fb02c71800c3. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:34:06.529068 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-52691bc6-e988-43e2-b544-40f6c2917190 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Getting quotas for user 8388303f9098497bb559b3bcb59fab52 and project cfb0b630e22745e8af15fb02c71800c3. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:34:06.782193 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-52691bc6-e988-43e2-b544-40f6c2917190 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.727169 Sep 01 16:34:06.787054 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 25/44] 10.222.0.18 () {62 vars in 1200 bytes} [Thu Sep 1 16:34:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 734 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 16:34:06.808185 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-56de69e1-3489-4f5a-8b67-c3b9ee5fa0b4 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeecf24670>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:06.942709 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-56de69e1-3489-4f5a-8b67-c3b9ee5fa0b4 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] HTTP exception thrown: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-56de69e1-3489-4f5a-8b67-c3b9ee5fa0b4 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Request method failure captured: Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/os-volumes/8f583dc2-5dca-450d-b54c-c0c8f63d8b61 HTTP/1.1 Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN7wIRhryxxW01CAm2HKgBCby3tQ3xNF9webyPQkLVO8Ovr0RbB10RufJk4pwlUjRzpz0ksjCSjUOq9asgLDq8f5TVazvW-WmzIX4lPMu0NSIPmb0fjmwNPwfxZRSbcgi971_L7tS4t61hEh--8FieOjFNk1NWK3OrBv4NxgxWvi3CE Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 170a066ef9584da0915a40ff4379c985 Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1030101819 Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:34:06.946035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:34:06.947406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/170a066ef9584da0915a40ff4379c985"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_170a066ef9584da0915a40ff4379c985"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/170a066ef9584da0915a40ff4379c985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/170a066ef9584da0915a40ff4379c985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:34:06.947406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1030101819 Sep 01 16:34:06.947406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 170a066ef9584da0915a40ff4379c985 Sep 01 16:34:06.947406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1030101819 Sep 01 16:34:06.947406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesSnapshotsTestJSON-1030101819-project Sep 01 16:34:06.947406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:34:06.947406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:34:06.947406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: d5e7228941074b579d0b11334226169c Sep 01 16:34:06.947406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1030101819-project Sep 01 16:34:06.947406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: Sep 01 16:34:06.947406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. Sep 01 16:34:06.947406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': '8f583dc2-5dca-450d-b54c-c0c8f63d8b61'} Sep 01 16:34:06.947406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. (HTTP 404) (Request-ID: req-bb2ffc7e-8311-416d-bd8a-578d26b375c1) Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:06.948522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:34:06.950330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 16:34:06.951822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:34:06.952891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. Sep 01 16:34:06.952891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:06.952891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:06.952891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:06.952891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:06.952891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:06.952891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:06.952891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:34:06.952891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:34:06.952891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. Sep 01 16:34:06.952891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:06.952891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-56de69e1-3489-4f5a-8b67-c3b9ee5fa0b4 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Returning 404 to user: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:34:06.952891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-56de69e1-3489-4f5a-8b67-c3b9ee5fa0b4 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8f583dc2-5dca-450d-b54c-c0c8f63d8b61" status: 404 len: 109 microversion: 2.1 time: 0.151784 Sep 01 16:34:06.952891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 26/45] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 1 16:34:06 2022] GET /compute/v2.1/os-volumes/8f583dc2-5dca-450d-b54c-c0c8f63d8b61 => generated 109 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:34:06.972970 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-136740e3-9f05-467f-be9f-6e20391a1336 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeecfaee50>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:07.083648 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-136740e3-9f05-467f-be9f-6e20391a1336 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] HTTP exception thrown: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-136740e3-9f05-467f-be9f-6e20391a1336 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Request method failure captured: Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: DELETE /compute/v2.1/os-volumes/8f583dc2-5dca-450d-b54c-c0c8f63d8b61 HTTP/1.1 Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN7wIRhryxxW01CAm2HKgBCby3tQ3xNF9webyPQkLVO8Ovr0RbB10RufJk4pwlUjRzpz0ksjCSjUOq9asgLDq8f5TVazvW-WmzIX4lPMu0NSIPmb0fjmwNPwfxZRSbcgi971_L7tS4t61hEh--8FieOjFNk1NWK3OrBv4NxgxWvi3CE Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 170a066ef9584da0915a40ff4379c985 Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1030101819 Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:34:07.085863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:34:07.087133 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/170a066ef9584da0915a40ff4379c985"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_170a066ef9584da0915a40ff4379c985"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/170a066ef9584da0915a40ff4379c985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/170a066ef9584da0915a40ff4379c985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:34:07.087133 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1030101819 Sep 01 16:34:07.087133 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 170a066ef9584da0915a40ff4379c985 Sep 01 16:34:07.087133 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1030101819 Sep 01 16:34:07.087133 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesSnapshotsTestJSON-1030101819-project Sep 01 16:34:07.087133 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:34:07.087133 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:34:07.087133 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: d5e7228941074b579d0b11334226169c Sep 01 16:34:07.087133 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1030101819-project Sep 01 16:34:07.087133 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: Sep 01 16:34:07.087133 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. Sep 01 16:34:07.087133 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': '8f583dc2-5dca-450d-b54c-c0c8f63d8b61'} Sep 01 16:34:07.087133 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. (HTTP 404) (Request-ID: req-bb57e33b-3727-4b2c-87da-d347d551fe30) Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:07.087853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:34:07.088865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 16:34:07.089780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:34:07.091600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. Sep 01 16:34:07.091600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:07.091600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:07.091600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:07.091600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:07.091600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:07.091600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:07.091600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:34:07.091600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:34:07.091600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. Sep 01 16:34:07.091600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:07.091600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-136740e3-9f05-467f-be9f-6e20391a1336 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Returning 404 to user: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:34:07.091600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-136740e3-9f05-467f-be9f-6e20391a1336 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/8f583dc2-5dca-450d-b54c-c0c8f63d8b61" status: 404 len: 109 microversion: 2.1 time: 0.125907 Sep 01 16:34:07.091600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 27/46] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 1 16:34:06 2022] DELETE /compute/v2.1/os-volumes/8f583dc2-5dca-450d-b54c-c0c8f63d8b61 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:34:07.095616 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a7105e26-e3fe-49a7-b6ee-631635362549 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Calling method '.version_select at 0x7feeecfcd430>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:07.149116 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-a7105e26-e3fe-49a7-b6ee-631635362549 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] HTTP exception thrown: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a7105e26-e3fe-49a7-b6ee-631635362549 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Request method failure captured: Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/os-volumes/8f583dc2-5dca-450d-b54c-c0c8f63d8b61 HTTP/1.1 Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN7wIRhryxxW01CAm2HKgBCby3tQ3xNF9webyPQkLVO8Ovr0RbB10RufJk4pwlUjRzpz0ksjCSjUOq9asgLDq8f5TVazvW-WmzIX4lPMu0NSIPmb0fjmwNPwfxZRSbcgi971_L7tS4t61hEh--8FieOjFNk1NWK3OrBv4NxgxWvi3CE Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 170a066ef9584da0915a40ff4379c985 Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1030101819 Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:34:07.151542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:34:07.152824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/170a066ef9584da0915a40ff4379c985"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_170a066ef9584da0915a40ff4379c985"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/170a066ef9584da0915a40ff4379c985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/170a066ef9584da0915a40ff4379c985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:34:07.152824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1030101819 Sep 01 16:34:07.152824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 170a066ef9584da0915a40ff4379c985 Sep 01 16:34:07.152824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1030101819 Sep 01 16:34:07.152824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesSnapshotsTestJSON-1030101819-project Sep 01 16:34:07.152824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:34:07.152824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:34:07.152824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: d5e7228941074b579d0b11334226169c Sep 01 16:34:07.152824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1030101819-project Sep 01 16:34:07.152824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: Sep 01 16:34:07.152824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. Sep 01 16:34:07.152824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': '8f583dc2-5dca-450d-b54c-c0c8f63d8b61'} Sep 01 16:34:07.152824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. (HTTP 404) (Request-ID: req-70d9847d-6099-4317-9fb5-d6fd6cfee310) Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:07.153563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:34:07.154762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 16:34:07.156417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:34:07.157368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. Sep 01 16:34:07.157368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:07.157368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:07.157368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:07.157368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:07.157368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:07.157368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:07.157368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:34:07.157368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:34:07.157368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. Sep 01 16:34:07.157368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:34:07.157368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a7105e26-e3fe-49a7-b6ee-631635362549 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] Returning 404 to user: Volume 8f583dc2-5dca-450d-b54c-c0c8f63d8b61 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:34:07.157368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a7105e26-e3fe-49a7-b6ee-631635362549 tempest-VolumesSnapshotsTestJSON-1030101819 tempest-VolumesSnapshotsTestJSON-1030101819-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8f583dc2-5dca-450d-b54c-c0c8f63d8b61" status: 404 len: 109 microversion: 2.1 time: 0.061211 Sep 01 16:34:07.157368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 28/47] 10.222.0.18 () {58 vars in 1245 bytes} [Thu Sep 1 16:34:07 2022] GET /compute/v2.1/os-volumes/8f583dc2-5dca-450d-b54c-c0c8f63d8b61 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:34:07.682140 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Flavor limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:34:07.682661 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Image limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:34:07.683125 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Flavor pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:34:07.684059 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Image pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:34:07.684461 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:34:07.735587 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:07.736359 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:07.739636 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:07.740707 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:07.741328 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:07.741904 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:07.834025 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Getting quotas for project 5c40a340919a49cc8b73687df600e2ea. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:34:07.852900 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Getting quotas for user b172f56cbd604342ba6d8169c969e157 and project 5c40a340919a49cc8b73687df600e2ea. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:34:07.894118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Going to run 1 instances... {{(pid=127178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:34:07.919698 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46185d58-0d47-4c97-b590-0f4434aa5c9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:34:08.149871 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7c0e173c-4ba7-40e6-8ebd-9e730d2ee842 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.278690 Sep 01 16:34:08.165345 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 20/48] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:34:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 16:34:08.177836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c19d89b0-d52e-4733-a039-d1ba68429bca tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:08.179191 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c19d89b0-d52e-4733-a039-d1ba68429bca tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:08.822310 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c19d89b0-d52e-4733-a039-d1ba68429bca tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:08.860046 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c19d89b0-d52e-4733-a039-d1ba68429bca tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1214 microversion: 2.1 time: 0.685871 Sep 01 16:34:08.860574 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 29/49] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:08 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1214 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:09.887030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-907fb8fb-9154-41eb-bdf6-9cfc733b09f0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:09.887790 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-907fb8fb-9154-41eb-bdf6-9cfc733b09f0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:10.207632 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-907fb8fb-9154-41eb-bdf6-9cfc733b09f0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:10.257555 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-907fb8fb-9154-41eb-bdf6-9cfc733b09f0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1214 microversion: 2.1 time: 0.365229 Sep 01 16:34:10.262273 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 21/50] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:09 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1214 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:10.892677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-39ac23f1-1542-4ed6-b064-fdd645a4665e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Action: 'create', calling method: .version_select at 0x7feeed06a0d0>, body: {"keypair": {"name": "tempest-keypair-718892069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwGQAXbZ5/NDob5B8fAamimpQcPjlZQATmC7oDedws+8PE4hZrIlxjslq008rZ2hG9eEmFxKIe0OW3eTDlRsFYpYxa3sI7v5/QF3syeEuTI3iwEZvG8WTuVA/ZXawOeeQ=="}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:10.930168 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-39ac23f1-1542-4ed6-b064-fdd645a4665e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Getting quotas for project aab96a55de014d8cac2c004ba7cadedd. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:34:10.936529 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-39ac23f1-1542-4ed6-b064-fdd645a4665e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Getting quotas for user 73624e79ccdd4782beddf663bb6d02e1 and project aab96a55de014d8cac2c004ba7cadedd. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:34:10.989057 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-39ac23f1-1542-4ed6-b064-fdd645a4665e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.842227 Sep 01 16:34:10.994800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 30/51] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 1 16:34:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:11.284021 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-24487b5c-d4f8-49e2-aed3-ac7beef45dac tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:11.287659 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-24487b5c-d4f8-49e2-aed3-ac7beef45dac tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:11.305365 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-24487b5c-d4f8-49e2-aed3-ac7beef45dac tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:11.306784 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-24487b5c-d4f8-49e2-aed3-ac7beef45dac tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:11.307814 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-24487b5c-d4f8-49e2-aed3-ac7beef45dac tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:11.309646 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-24487b5c-d4f8-49e2-aed3-ac7beef45dac tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:11.316443 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-24487b5c-d4f8-49e2-aed3-ac7beef45dac tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:11.317249 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-24487b5c-d4f8-49e2-aed3-ac7beef45dac tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:11.718623 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-24487b5c-d4f8-49e2-aed3-ac7beef45dac tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:11.757557 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-24487b5c-d4f8-49e2-aed3-ac7beef45dac tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1210 microversion: 2.1 time: 0.479371 Sep 01 16:34:11.760812 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 22/52] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:11 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1210 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:12.791215 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4cf90c62-8d42-444e-9d52-bfc1622ff7e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:12.792122 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4cf90c62-8d42-444e-9d52-bfc1622ff7e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:12.806723 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4cf90c62-8d42-444e-9d52-bfc1622ff7e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:12.809709 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4cf90c62-8d42-444e-9d52-bfc1622ff7e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:12.813287 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4cf90c62-8d42-444e-9d52-bfc1622ff7e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:12.814895 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4cf90c62-8d42-444e-9d52-bfc1622ff7e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:12.817950 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4cf90c62-8d42-444e-9d52-bfc1622ff7e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:12.820015 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4cf90c62-8d42-444e-9d52-bfc1622ff7e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:13.548423 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4cf90c62-8d42-444e-9d52-bfc1622ff7e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:13.595820 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4cf90c62-8d42-444e-9d52-bfc1622ff7e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1272 microversion: 2.1 time: 0.810165 Sep 01 16:34:13.611111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 31/53] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:12 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1272 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:14.623267 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e50fea2b-8cc7-47c0-9b66-2d13a4e8717d tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:14.623875 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e50fea2b-8cc7-47c0-9b66-2d13a4e8717d tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:14.633733 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e50fea2b-8cc7-47c0-9b66-2d13a4e8717d tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:14.639594 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e50fea2b-8cc7-47c0-9b66-2d13a4e8717d tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:14.641606 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e50fea2b-8cc7-47c0-9b66-2d13a4e8717d tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:14.644118 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e50fea2b-8cc7-47c0-9b66-2d13a4e8717d tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:14.651271 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e50fea2b-8cc7-47c0-9b66-2d13a4e8717d tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:14.652530 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e50fea2b-8cc7-47c0-9b66-2d13a4e8717d tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:15.189136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-824565122", "imageRef": "46185d58-0d47-4c97-b590-0f4434aa5c9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:15.350545 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.network.neutron [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] validate_networks() for [('f8d9b7d6-ff49-44c9-b2ab-e77725fc0de7', None, None, None, None, None)] {{(pid=127178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:34:15.545690 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e50fea2b-8cc7-47c0-9b66-2d13a4e8717d tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:15.570335 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e50fea2b-8cc7-47c0-9b66-2d13a4e8717d tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.947766 Sep 01 16:34:15.572676 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 32/54] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:14 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:15.587236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1078412783", "imageRef": "46185d58-0d47-4c97-b590-0f4434aa5c9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e2386a0-52ae-4650-b501-6e8c6cdd7cc9"}], "security_groups": [{"name": "tempest-securitygroup--263685407"}], "key_name": "tempest-keypair-1154839340", "user_data": "}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:16.025780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] validate_networks() for [('1e2386a0-52ae-4650-b501-6e8c6cdd7cc9', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:34:16.607021 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Flavor limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:34:16.608854 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Image limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:34:16.610005 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Flavor pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:34:16.610676 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Image pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:34:16.611639 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:34:16.641683 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:16.644767 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:16.645711 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:16.646776 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:16.659439 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:16.660110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:16.699330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Getting quotas for project b4bbb5d3895c49fa8695d3bca946dbea. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:34:16.720621 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Getting quotas for user 8020db56bca04d61b5a6e40384c25715 and project b4bbb5d3895c49fa8695d3bca946dbea. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:34:16.743468 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Going to run 1 instances... {{(pid=127178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:34:16.746533 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46185d58-0d47-4c97-b590-0f4434aa5c9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:34:16.871070 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-1099f12e-4925-4554-a116-a7cc996817f1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.830899 Sep 01 16:34:16.884137 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 23/55] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:34:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:34:16.898519 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6148861f-8169-4821-af20-6741ddc1cfbf tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:16.899277 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-6148861f-8169-4821-af20-6741ddc1cfbf tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:16.938494 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6148861f-8169-4821-af20-6741ddc1cfbf tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:16.940747 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6148861f-8169-4821-af20-6741ddc1cfbf tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:16.941880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6148861f-8169-4821-af20-6741ddc1cfbf tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:16.943395 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6148861f-8169-4821-af20-6741ddc1cfbf tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:16.945758 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6148861f-8169-4821-af20-6741ddc1cfbf tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:16.947092 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6148861f-8169-4821-af20-6741ddc1cfbf tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:17.280860 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-6148861f-8169-4821-af20-6741ddc1cfbf tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:17.309104 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-6148861f-8169-4821-af20-6741ddc1cfbf tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.416846 Sep 01 16:34:17.310525 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 24/56] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:16 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:17.322562 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-48bb8548-5001-480c-888e-7b5742480759 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:17.323715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-48bb8548-5001-480c-888e-7b5742480759 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:17.433056 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-48bb8548-5001-480c-888e-7b5742480759 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:17.456071 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-48bb8548-5001-480c-888e-7b5742480759 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1221 microversion: 2.1 time: 0.143505 Sep 01 16:34:17.457276 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 25/57] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:17 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1221 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:17.789431 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1446792738", "imageRef": "46185d58-0d47-4c97-b590-0f4434aa5c9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba8f8151-1775-4d72-8643-4c1aec9c20a0"}], "security_groups": [{"name": "tempest-securitygroup--929957360"}], "key_name": "tempest-keypair-718892069", "user_data": "}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:18.384796 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:34:18.385313 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:34:18.385841 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:34:18.386327 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:34:18.386709 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:34:18.411124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:18.411776 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:18.412255 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:18.413026 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:18.413639 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:18.414060 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:18.526170 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Getting quotas for project cfb0b630e22745e8af15fb02c71800c3. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:34:18.533830 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Getting quotas for user 8388303f9098497bb559b3bcb59fab52 and project cfb0b630e22745e8af15fb02c71800c3. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:34:18.555950 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:34:18.564500 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46185d58-0d47-4c97-b590-0f4434aa5c9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:34:18.736091 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-916d075a-e4d1-4b58-9e09-b8e0f7d66657 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.160920 Sep 01 16:34:18.737244 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 33/58] 10.222.0.18 () {62 vars in 1188 bytes} [Thu Sep 1 16:34:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 3164 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 16:34:18.752792 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1155432381", "imageRef": "46185d58-0d47-4c97-b590-0f4434aa5c9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:18.876905 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] validate_networks() for [('f8d9b7d6-ff49-44c9-b2ab-e77725fc0de7', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:34:19.137835 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.network.neutron [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] validate_networks() for [('ba8f8151-1775-4d72-8643-4c1aec9c20a0', None, None, None, None, None)] {{(pid=127178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:34:20.846294 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:34:20.846879 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:34:20.847702 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:34:20.848131 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:34:20.848614 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:34:20.908964 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:20.911862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:20.913566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:20.915241 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:20.919248 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:20.921326 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:21.038673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Getting quotas for project b4bbb5d3895c49fa8695d3bca946dbea. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:34:21.048656 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Getting quotas for user 8020db56bca04d61b5a6e40384c25715 and project b4bbb5d3895c49fa8695d3bca946dbea. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:34:21.093689 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:34:21.096879 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46185d58-0d47-4c97-b590-0f4434aa5c9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:34:21.257253 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f3c96bc0-2d41-488a-ba2e-473ed5f4539a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.516025 Sep 01 16:34:21.263236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 34/59] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:34:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:34:21.274044 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f5aabf04-e4a9-4b57-9725-6c97eb6ac7e9 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:21.274924 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f5aabf04-e4a9-4b57-9725-6c97eb6ac7e9 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:21.290116 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f5aabf04-e4a9-4b57-9725-6c97eb6ac7e9 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:21.303915 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f5aabf04-e4a9-4b57-9725-6c97eb6ac7e9 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:21.304739 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f5aabf04-e4a9-4b57-9725-6c97eb6ac7e9 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:21.305761 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f5aabf04-e4a9-4b57-9725-6c97eb6ac7e9 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:21.306490 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f5aabf04-e4a9-4b57-9725-6c97eb6ac7e9 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:21.307425 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f5aabf04-e4a9-4b57-9725-6c97eb6ac7e9 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:21.875079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Flavor limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:34:21.875683 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Image limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:34:21.876289 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Flavor pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:34:21.877386 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Image pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:34:21.878383 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:34:21.938327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:21.942138 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:21.944587 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:21.949741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:21.951288 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:21.954082 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:22.009833 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Getting quotas for project aab96a55de014d8cac2c004ba7cadedd. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:34:22.024744 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Getting quotas for user 73624e79ccdd4782beddf663bb6d02e1 and project aab96a55de014d8cac2c004ba7cadedd. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:34:22.061869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Going to run 1 instances... {{(pid=127178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:34:22.073473 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46185d58-0d47-4c97-b590-0f4434aa5c9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:34:22.217719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-1a163b35-e9d0-4bd7-8e04-3287facceff7 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.433823 Sep 01 16:34:22.219149 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 26/60] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:34:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 4436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:34:22.224599 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c2e32a83-321b-4c06-93ca-1c46e19faf06 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:22.225446 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c2e32a83-321b-4c06-93ca-1c46e19faf06 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:22.233277 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c2e32a83-321b-4c06-93ca-1c46e19faf06 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:22.234528 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c2e32a83-321b-4c06-93ca-1c46e19faf06 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:22.235211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c2e32a83-321b-4c06-93ca-1c46e19faf06 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:22.236217 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c2e32a83-321b-4c06-93ca-1c46e19faf06 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:22.238464 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c2e32a83-321b-4c06-93ca-1c46e19faf06 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:22.239125 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c2e32a83-321b-4c06-93ca-1c46e19faf06 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:22.317759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f5aabf04-e4a9-4b57-9725-6c97eb6ac7e9 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:22.331870 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f5aabf04-e4a9-4b57-9725-6c97eb6ac7e9 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 1.067070 Sep 01 16:34:22.333803 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 35/61] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:21 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:22.342352 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4a1bf754-08c6-41e5-a7a3-78e646ea56b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:22.343879 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4a1bf754-08c6-41e5-a7a3-78e646ea56b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:22.346650 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c2e32a83-321b-4c06-93ca-1c46e19faf06 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:22.357772 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c2e32a83-321b-4c06-93ca-1c46e19faf06 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:22.361133 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c2e32a83-321b-4c06-93ca-1c46e19faf06 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:22.361620 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a1bf754-08c6-41e5-a7a3-78e646ea56b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:22.362125 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a1bf754-08c6-41e5-a7a3-78e646ea56b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:22.364057 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c2e32a83-321b-4c06-93ca-1c46e19faf06 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1334 microversion: 2.20 time: 0.143746 Sep 01 16:34:22.366548 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 27/62] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:22 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1334 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:22.368228 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a1bf754-08c6-41e5-a7a3-78e646ea56b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:22.369112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a1bf754-08c6-41e5-a7a3-78e646ea56b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:22.369591 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a1bf754-08c6-41e5-a7a3-78e646ea56b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:22.370190 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a1bf754-08c6-41e5-a7a3-78e646ea56b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:22.487402 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4a1bf754-08c6-41e5-a7a3-78e646ea56b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:22.495210 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-2c017d5a-e42d-4eec-a23c-53aaa26df225 req-c0454ac1-380f-481f-a53c-528797d7c47a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af33e17-eea1-4429-bca2-299dc3f02bf8", "tag": "b086b899-9326-4795-b2fc-0c23a4a38451"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:22.499492 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4a1bf754-08c6-41e5-a7a3-78e646ea56b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1226 microversion: 2.1 time: 0.164172 Sep 01 16:34:22.531681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 36/63] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:22 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1226 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:22.541863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-38d2243a-a2fa-4443-a701-c470a6725c2d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:22.544597 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-38d2243a-a2fa-4443-a701-c470a6725c2d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:22.577185 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-2c017d5a-e42d-4eec-a23c-53aaa26df225 req-c0454ac1-380f-481f-a53c-528797d7c47a service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:22.580577 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-2c017d5a-e42d-4eec-a23c-53aaa26df225 req-c0454ac1-380f-481f-a53c-528797d7c47a service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:22.583650 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-2c017d5a-e42d-4eec-a23c-53aaa26df225 req-c0454ac1-380f-481f-a53c-528797d7c47a service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:22.650503 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-2c017d5a-e42d-4eec-a23c-53aaa26df225 req-c0454ac1-380f-481f-a53c-528797d7c47a service nova] Creating event network-changed:b086b899-9326-4795-b2fc-0c23a4a38451 for instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 on hv-cinder-85220 Sep 01 16:34:22.651034 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-2c017d5a-e42d-4eec-a23c-53aaa26df225 req-c0454ac1-380f-481f-a53c-528797d7c47a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127178) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 16:34:22.651424 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-2c017d5a-e42d-4eec-a23c-53aaa26df225 req-c0454ac1-380f-481f-a53c-528797d7c47a service nova] Acquired lock "compute-rpcapi-router" {{(pid=127178) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 16:34:22.653255 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b040d6b1-701b-4fe2-8068-2b91e2bf6b18 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:22.653587 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b040d6b1-701b-4fe2-8068-2b91e2bf6b18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:22.655621 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b040d6b1-701b-4fe2-8068-2b91e2bf6b18 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:22.656504 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b040d6b1-701b-4fe2-8068-2b91e2bf6b18 None None] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:22.665281 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b040d6b1-701b-4fe2-8068-2b91e2bf6b18 None None] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:22.665893 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b040d6b1-701b-4fe2-8068-2b91e2bf6b18 None None] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:22.675924 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.compute.rpcapi [None req-b040d6b1-701b-4fe2-8068-2b91e2bf6b18 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 16:34:22.689249 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b040d6b1-701b-4fe2-8068-2b91e2bf6b18 None None] Releasing lock "compute-rpcapi-router" {{(pid=127178) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 16:34:22.712854 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b040d6b1-701b-4fe2-8068-2b91e2bf6b18 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.339576 Sep 01 16:34:22.719399 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 28/64] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:22.785750 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-38d2243a-a2fa-4443-a701-c470a6725c2d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:22.807222 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-38d2243a-a2fa-4443-a701-c470a6725c2d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1237 microversion: 2.1 time: 0.273455 Sep 01 16:34:22.808457 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 37/65] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:22 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1237 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:23.358226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ee9b28c7-c2ff-4cf2-bdc3-630d27e3b180 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:23.358971 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ee9b28c7-c2ff-4cf2-bdc3-630d27e3b180 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:23.370463 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee9b28c7-c2ff-4cf2-bdc3-630d27e3b180 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:23.370988 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee9b28c7-c2ff-4cf2-bdc3-630d27e3b180 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:23.371464 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee9b28c7-c2ff-4cf2-bdc3-630d27e3b180 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:23.372211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee9b28c7-c2ff-4cf2-bdc3-630d27e3b180 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:23.372668 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee9b28c7-c2ff-4cf2-bdc3-630d27e3b180 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:23.373096 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee9b28c7-c2ff-4cf2-bdc3-630d27e3b180 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:23.385843 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-82f330c4-daf1-4424-9001-b196e5676be5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:23.386719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-82f330c4-daf1-4424-9001-b196e5676be5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:23.392895 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82f330c4-daf1-4424-9001-b196e5676be5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:23.393465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82f330c4-daf1-4424-9001-b196e5676be5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:23.393967 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82f330c4-daf1-4424-9001-b196e5676be5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:23.394706 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82f330c4-daf1-4424-9001-b196e5676be5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:23.395323 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82f330c4-daf1-4424-9001-b196e5676be5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:23.395745 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82f330c4-daf1-4424-9001-b196e5676be5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:23.462860 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-82f330c4-daf1-4424-9001-b196e5676be5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:23.473592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-82f330c4-daf1-4424-9001-b196e5676be5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:23.477536 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-82f330c4-daf1-4424-9001-b196e5676be5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:23.478796 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-82f330c4-daf1-4424-9001-b196e5676be5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1334 microversion: 2.20 time: 0.097163 Sep 01 16:34:23.479552 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 38/66] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:23 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1334 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:23.514789 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ee9b28c7-c2ff-4cf2-bdc3-630d27e3b180 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:23.521382 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b6a38669-737f-47b7-958a-f5568d88572c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:23.521990 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b6a38669-737f-47b7-958a-f5568d88572c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:23.523317 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ee9b28c7-c2ff-4cf2-bdc3-630d27e3b180 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.169922 Sep 01 16:34:23.524313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 29/67] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:23 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:23.529110 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6a38669-737f-47b7-958a-f5568d88572c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:23.529598 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6a38669-737f-47b7-958a-f5568d88572c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:23.530029 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6a38669-737f-47b7-958a-f5568d88572c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:23.530794 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6a38669-737f-47b7-958a-f5568d88572c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:23.531246 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6a38669-737f-47b7-958a-f5568d88572c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:23.531666 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6a38669-737f-47b7-958a-f5568d88572c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:23.600797 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b6a38669-737f-47b7-958a-f5568d88572c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:23.613829 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b6a38669-737f-47b7-958a-f5568d88572c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1226 microversion: 2.1 time: 0.095942 Sep 01 16:34:23.614874 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 39/68] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:23 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:23.838925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f5f612ea-4aa3-49f0-9447-9cc7ff5cbadc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:23.842220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f5f612ea-4aa3-49f0-9447-9cc7ff5cbadc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:23.858546 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f5f612ea-4aa3-49f0-9447-9cc7ff5cbadc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:23.859597 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f5f612ea-4aa3-49f0-9447-9cc7ff5cbadc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:23.860580 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f5f612ea-4aa3-49f0-9447-9cc7ff5cbadc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:23.869070 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f5f612ea-4aa3-49f0-9447-9cc7ff5cbadc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:23.869972 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f5f612ea-4aa3-49f0-9447-9cc7ff5cbadc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:23.871078 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f5f612ea-4aa3-49f0-9447-9cc7ff5cbadc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:23.967749 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f5f612ea-4aa3-49f0-9447-9cc7ff5cbadc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:23.975720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f5f612ea-4aa3-49f0-9447-9cc7ff5cbadc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1241 microversion: 2.1 time: 0.143671 Sep 01 16:34:23.976288 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 30/69] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:23 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1241 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:24.516958 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8756fde0-e238-40d4-8f0c-d4fc286eb954 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:24.517951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8756fde0-e238-40d4-8f0c-d4fc286eb954 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:24.532928 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8756fde0-e238-40d4-8f0c-d4fc286eb954 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:24.534983 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8756fde0-e238-40d4-8f0c-d4fc286eb954 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:24.536026 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8756fde0-e238-40d4-8f0c-d4fc286eb954 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:24.540772 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8756fde0-e238-40d4-8f0c-d4fc286eb954 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:24.542115 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8756fde0-e238-40d4-8f0c-d4fc286eb954 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:24.557606 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-485c93c2-22b8-4ff1-97bd-e4d1eed28301 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:24.561244 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-485c93c2-22b8-4ff1-97bd-e4d1eed28301 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:24.566656 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8756fde0-e238-40d4-8f0c-d4fc286eb954 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:24.568309 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-485c93c2-22b8-4ff1-97bd-e4d1eed28301 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:24.572988 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-485c93c2-22b8-4ff1-97bd-e4d1eed28301 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:24.573958 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-485c93c2-22b8-4ff1-97bd-e4d1eed28301 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:24.594799 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-485c93c2-22b8-4ff1-97bd-e4d1eed28301 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:24.598587 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-485c93c2-22b8-4ff1-97bd-e4d1eed28301 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:24.598983 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-485c93c2-22b8-4ff1-97bd-e4d1eed28301 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:24.738933 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8756fde0-e238-40d4-8f0c-d4fc286eb954 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:24.768463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8756fde0-e238-40d4-8f0c-d4fc286eb954 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:24.776511 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8756fde0-e238-40d4-8f0c-d4fc286eb954 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:24.778834 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8756fde0-e238-40d4-8f0c-d4fc286eb954 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1334 microversion: 2.20 time: 0.266287 Sep 01 16:34:24.790267 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 40/70] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:24 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1334 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:24.791708 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-788cb984-3654-4d21-8213-b9c0076d147a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:24.792510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-788cb984-3654-4d21-8213-b9c0076d147a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:24.827583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-788cb984-3654-4d21-8213-b9c0076d147a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:24.828259 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-788cb984-3654-4d21-8213-b9c0076d147a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:24.828828 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-788cb984-3654-4d21-8213-b9c0076d147a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:24.829744 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-788cb984-3654-4d21-8213-b9c0076d147a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:24.830406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-788cb984-3654-4d21-8213-b9c0076d147a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:24.835301 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-788cb984-3654-4d21-8213-b9c0076d147a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:24.918286 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-788cb984-3654-4d21-8213-b9c0076d147a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:24.928737 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-788cb984-3654-4d21-8213-b9c0076d147a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1226 microversion: 2.1 time: 0.143284 Sep 01 16:34:24.944155 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 41/71] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:24 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1226 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:24.998543 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1c03d7bf-a3f2-48fa-8667-949245e6f592 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:24.999540 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1c03d7bf-a3f2-48fa-8667-949245e6f592 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:25.011842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c03d7bf-a3f2-48fa-8667-949245e6f592 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:25.012528 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c03d7bf-a3f2-48fa-8667-949245e6f592 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:25.013296 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c03d7bf-a3f2-48fa-8667-949245e6f592 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:25.014217 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c03d7bf-a3f2-48fa-8667-949245e6f592 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:25.018387 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c03d7bf-a3f2-48fa-8667-949245e6f592 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:25.019143 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c03d7bf-a3f2-48fa-8667-949245e6f592 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:25.131832 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1c03d7bf-a3f2-48fa-8667-949245e6f592 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:25.140933 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1c03d7bf-a3f2-48fa-8667-949245e6f592 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1241 microversion: 2.1 time: 0.146897 Sep 01 16:34:25.143916 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 42/72] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:24 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1241 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:25.241153 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-485c93c2-22b8-4ff1-97bd-e4d1eed28301 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:25.249975 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-485c93c2-22b8-4ff1-97bd-e4d1eed28301 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.696615 Sep 01 16:34:25.250901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 31/73] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:24 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:25.806137 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4003ca87-0371-4d44-9b91-1f91b7cf7ce2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:25.807220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4003ca87-0371-4d44-9b91-1f91b7cf7ce2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:25.815546 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4003ca87-0371-4d44-9b91-1f91b7cf7ce2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:25.816358 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4003ca87-0371-4d44-9b91-1f91b7cf7ce2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:25.817076 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4003ca87-0371-4d44-9b91-1f91b7cf7ce2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:25.818298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4003ca87-0371-4d44-9b91-1f91b7cf7ce2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:25.819103 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4003ca87-0371-4d44-9b91-1f91b7cf7ce2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:25.819929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4003ca87-0371-4d44-9b91-1f91b7cf7ce2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:25.897675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4003ca87-0371-4d44-9b91-1f91b7cf7ce2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:25.907695 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4003ca87-0371-4d44-9b91-1f91b7cf7ce2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:25.909487 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4003ca87-0371-4d44-9b91-1f91b7cf7ce2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:25.910622 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4003ca87-0371-4d44-9b91-1f91b7cf7ce2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1334 microversion: 2.20 time: 0.108750 Sep 01 16:34:25.911176 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 43/74] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:25 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1334 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:25.957779 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-59e73edf-16e0-4939-94bc-30045ab782bc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:25.958728 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-59e73edf-16e0-4939-94bc-30045ab782bc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:25.969545 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59e73edf-16e0-4939-94bc-30045ab782bc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:25.970369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59e73edf-16e0-4939-94bc-30045ab782bc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:25.971085 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59e73edf-16e0-4939-94bc-30045ab782bc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:25.972254 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59e73edf-16e0-4939-94bc-30045ab782bc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:25.973007 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59e73edf-16e0-4939-94bc-30045ab782bc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:25.973889 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59e73edf-16e0-4939-94bc-30045ab782bc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:26.048317 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-59e73edf-16e0-4939-94bc-30045ab782bc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:26.064034 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-59e73edf-16e0-4939-94bc-30045ab782bc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1226 microversion: 2.1 time: 0.113114 Sep 01 16:34:26.065082 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 32/75] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:25 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:26.164940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-da695714-02b2-47b2-84a3-fc5c1dba7b40 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:26.165567 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-da695714-02b2-47b2-84a3-fc5c1dba7b40 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:26.172417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-da695714-02b2-47b2-84a3-fc5c1dba7b40 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:26.172903 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-da695714-02b2-47b2-84a3-fc5c1dba7b40 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:26.173337 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-da695714-02b2-47b2-84a3-fc5c1dba7b40 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:26.174034 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-da695714-02b2-47b2-84a3-fc5c1dba7b40 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:26.174516 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-da695714-02b2-47b2-84a3-fc5c1dba7b40 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:26.174933 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-da695714-02b2-47b2-84a3-fc5c1dba7b40 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:26.238835 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-da695714-02b2-47b2-84a3-fc5c1dba7b40 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:26.254658 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-da695714-02b2-47b2-84a3-fc5c1dba7b40 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1241 microversion: 2.1 time: 0.093159 Sep 01 16:34:26.266274 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 44/76] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:26 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:26.292023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ca4c1019-ffb4-45c1-8064-226b33a7ce0c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:26.292641 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ca4c1019-ffb4-45c1-8064-226b33a7ce0c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:26.298613 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ca4c1019-ffb4-45c1-8064-226b33a7ce0c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:26.299096 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ca4c1019-ffb4-45c1-8064-226b33a7ce0c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:26.299522 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ca4c1019-ffb4-45c1-8064-226b33a7ce0c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:26.300209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ca4c1019-ffb4-45c1-8064-226b33a7ce0c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:26.300651 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ca4c1019-ffb4-45c1-8064-226b33a7ce0c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:26.301069 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ca4c1019-ffb4-45c1-8064-226b33a7ce0c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:26.476029 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ca4c1019-ffb4-45c1-8064-226b33a7ce0c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:26.486104 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ca4c1019-ffb4-45c1-8064-226b33a7ce0c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.198399 Sep 01 16:34:26.494336 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 33/77] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:26 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:26.936150 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-621316b8-8f19-4433-ad2d-6f1f84fd94cb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:26.936788 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-621316b8-8f19-4433-ad2d-6f1f84fd94cb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:26.943540 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-621316b8-8f19-4433-ad2d-6f1f84fd94cb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:26.944031 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-621316b8-8f19-4433-ad2d-6f1f84fd94cb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:26.944458 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-621316b8-8f19-4433-ad2d-6f1f84fd94cb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:26.945388 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-621316b8-8f19-4433-ad2d-6f1f84fd94cb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:26.945840 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-621316b8-8f19-4433-ad2d-6f1f84fd94cb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:26.946340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-621316b8-8f19-4433-ad2d-6f1f84fd94cb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:27.021261 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-621316b8-8f19-4433-ad2d-6f1f84fd94cb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:27.031604 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-621316b8-8f19-4433-ad2d-6f1f84fd94cb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:27.033034 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-621316b8-8f19-4433-ad2d-6f1f84fd94cb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:27.034288 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-621316b8-8f19-4433-ad2d-6f1f84fd94cb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1334 microversion: 2.20 time: 0.102440 Sep 01 16:34:27.034843 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 45/78] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:26 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1334 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:27.090677 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c198416f-be83-4fde-af82-1590088f6101 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:27.091672 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c198416f-be83-4fde-af82-1590088f6101 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:27.103245 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c198416f-be83-4fde-af82-1590088f6101 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:27.104369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c198416f-be83-4fde-af82-1590088f6101 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:27.105577 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c198416f-be83-4fde-af82-1590088f6101 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:27.106823 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c198416f-be83-4fde-af82-1590088f6101 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:27.107689 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c198416f-be83-4fde-af82-1590088f6101 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:27.108368 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c198416f-be83-4fde-af82-1590088f6101 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:27.203590 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c198416f-be83-4fde-af82-1590088f6101 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:27.211559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c198416f-be83-4fde-af82-1590088f6101 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1226 microversion: 2.1 time: 0.128026 Sep 01 16:34:27.212220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 34/79] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:27 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1226 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:27.280174 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a54cd1ed-2a45-4c1c-adb9-63fc6ab23793 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:27.280807 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a54cd1ed-2a45-4c1c-adb9-63fc6ab23793 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:27.290933 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a54cd1ed-2a45-4c1c-adb9-63fc6ab23793 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:27.291840 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a54cd1ed-2a45-4c1c-adb9-63fc6ab23793 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:27.292613 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a54cd1ed-2a45-4c1c-adb9-63fc6ab23793 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:27.293937 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a54cd1ed-2a45-4c1c-adb9-63fc6ab23793 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:27.294878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a54cd1ed-2a45-4c1c-adb9-63fc6ab23793 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:27.296105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a54cd1ed-2a45-4c1c-adb9-63fc6ab23793 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:27.435931 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a54cd1ed-2a45-4c1c-adb9-63fc6ab23793 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:27.464114 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a54cd1ed-2a45-4c1c-adb9-63fc6ab23793 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1241 microversion: 2.1 time: 0.189213 Sep 01 16:34:27.470916 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 46/80] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:27 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1241 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:27.507430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-debf4dce-b833-4e24-9b4b-34cc3323c8fc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:27.508075 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-debf4dce-b833-4e24-9b4b-34cc3323c8fc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:27.515026 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-debf4dce-b833-4e24-9b4b-34cc3323c8fc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:27.515515 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-debf4dce-b833-4e24-9b4b-34cc3323c8fc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:27.515948 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-debf4dce-b833-4e24-9b4b-34cc3323c8fc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:27.516638 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-debf4dce-b833-4e24-9b4b-34cc3323c8fc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:27.517249 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-debf4dce-b833-4e24-9b4b-34cc3323c8fc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:27.517819 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-debf4dce-b833-4e24-9b4b-34cc3323c8fc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:27.836701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-debf4dce-b833-4e24-9b4b-34cc3323c8fc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:27.851773 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-debf4dce-b833-4e24-9b4b-34cc3323c8fc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.348405 Sep 01 16:34:27.852491 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 35/81] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:27 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:28.057104 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-784a84c5-8f68-4bac-aedc-68af579e1a8e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:28.057720 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-784a84c5-8f68-4bac-aedc-68af579e1a8e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:28.080560 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-784a84c5-8f68-4bac-aedc-68af579e1a8e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.081303 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-784a84c5-8f68-4bac-aedc-68af579e1a8e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.081850 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-784a84c5-8f68-4bac-aedc-68af579e1a8e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:28.084843 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-784a84c5-8f68-4bac-aedc-68af579e1a8e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.087588 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-784a84c5-8f68-4bac-aedc-68af579e1a8e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.088566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-784a84c5-8f68-4bac-aedc-68af579e1a8e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:28.232846 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c902ec53-e8f2-4324-b9ca-78dd3e35ff41 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:28.234809 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c902ec53-e8f2-4324-b9ca-78dd3e35ff41 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:28.255050 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c902ec53-e8f2-4324-b9ca-78dd3e35ff41 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.256047 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c902ec53-e8f2-4324-b9ca-78dd3e35ff41 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.256669 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c902ec53-e8f2-4324-b9ca-78dd3e35ff41 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:28.259874 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c902ec53-e8f2-4324-b9ca-78dd3e35ff41 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.260463 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c902ec53-e8f2-4324-b9ca-78dd3e35ff41 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.264211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c902ec53-e8f2-4324-b9ca-78dd3e35ff41 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:28.301471 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-784a84c5-8f68-4bac-aedc-68af579e1a8e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:28.333434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-784a84c5-8f68-4bac-aedc-68af579e1a8e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:28.341830 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-784a84c5-8f68-4bac-aedc-68af579e1a8e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:28.343941 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-784a84c5-8f68-4bac-aedc-68af579e1a8e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1334 microversion: 2.20 time: 0.290413 Sep 01 16:34:28.347584 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 47/82] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:28 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1334 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:28.419266 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c902ec53-e8f2-4324-b9ca-78dd3e35ff41 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:28.430538 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c902ec53-e8f2-4324-b9ca-78dd3e35ff41 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1226 microversion: 2.1 time: 0.201772 Sep 01 16:34:28.444500 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 36/83] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:28 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1226 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:28.497723 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c725e9e3-227c-48f2-921d-53ecbc748b64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:28.500860 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c725e9e3-227c-48f2-921d-53ecbc748b64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:28.517850 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c725e9e3-227c-48f2-921d-53ecbc748b64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.522644 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c725e9e3-227c-48f2-921d-53ecbc748b64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.523444 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c725e9e3-227c-48f2-921d-53ecbc748b64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:28.524582 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c725e9e3-227c-48f2-921d-53ecbc748b64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.525401 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c725e9e3-227c-48f2-921d-53ecbc748b64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.530211 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c725e9e3-227c-48f2-921d-53ecbc748b64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:28.671890 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c725e9e3-227c-48f2-921d-53ecbc748b64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:28.681026 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c725e9e3-227c-48f2-921d-53ecbc748b64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1241 microversion: 2.1 time: 0.190707 Sep 01 16:34:28.682912 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 48/84] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:28 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1241 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:28.880984 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e8226dbf-28b4-4e53-ad7c-35fe5f5152fb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:28.883729 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-e8226dbf-28b4-4e53-ad7c-35fe5f5152fb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:28.931639 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8226dbf-28b4-4e53-ad7c-35fe5f5152fb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.933693 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8226dbf-28b4-4e53-ad7c-35fe5f5152fb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.936450 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8226dbf-28b4-4e53-ad7c-35fe5f5152fb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:28.936450 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8226dbf-28b4-4e53-ad7c-35fe5f5152fb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.937034 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8226dbf-28b4-4e53-ad7c-35fe5f5152fb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.937562 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8226dbf-28b4-4e53-ad7c-35fe5f5152fb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:29.272129 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e8226dbf-28b4-4e53-ad7c-35fe5f5152fb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:29.284647 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-e8226dbf-28b4-4e53-ad7c-35fe5f5152fb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.411980 Sep 01 16:34:29.285313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 37/85] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:28 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:29.377126 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-06d9767e-4ec4-4399-833c-85fb8dd0902e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:29.377975 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-06d9767e-4ec4-4399-833c-85fb8dd0902e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:29.387572 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-06d9767e-4ec4-4399-833c-85fb8dd0902e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:29.388455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-06d9767e-4ec4-4399-833c-85fb8dd0902e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:29.389586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-06d9767e-4ec4-4399-833c-85fb8dd0902e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:29.391378 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-06d9767e-4ec4-4399-833c-85fb8dd0902e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:29.392115 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-06d9767e-4ec4-4399-833c-85fb8dd0902e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:29.392736 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-06d9767e-4ec4-4399-833c-85fb8dd0902e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:29.453005 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6703a074-ee36-4684-91c8-68156b0bb995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:29.453933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-6703a074-ee36-4684-91c8-68156b0bb995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:29.460190 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6703a074-ee36-4684-91c8-68156b0bb995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:29.460665 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6703a074-ee36-4684-91c8-68156b0bb995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:29.461088 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6703a074-ee36-4684-91c8-68156b0bb995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:29.461785 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6703a074-ee36-4684-91c8-68156b0bb995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:29.462221 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6703a074-ee36-4684-91c8-68156b0bb995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:29.462818 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6703a074-ee36-4684-91c8-68156b0bb995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:29.483250 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-06d9767e-4ec4-4399-833c-85fb8dd0902e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:29.488793 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:29.495532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-06d9767e-4ec4-4399-833c-85fb8dd0902e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:29.497113 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-06d9767e-4ec4-4399-833c-85fb8dd0902e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:29.498512 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-06d9767e-4ec4-4399-833c-85fb8dd0902e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1334 microversion: 2.20 time: 0.126679 Sep 01 16:34:29.499385 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 49/86] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:29 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1334 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:29.546731 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-6703a074-ee36-4684-91c8-68156b0bb995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:29.557155 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-6703a074-ee36-4684-91c8-68156b0bb995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1226 microversion: 2.1 time: 0.107884 Sep 01 16:34:29.558203 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 38/87] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:29 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:29.704942 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0206cfaa-8e2e-4a94-b765-5c0dfd32087c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:29.705585 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0206cfaa-8e2e-4a94-b765-5c0dfd32087c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:29.711185 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:29.713805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0206cfaa-8e2e-4a94-b765-5c0dfd32087c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:29.715149 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0206cfaa-8e2e-4a94-b765-5c0dfd32087c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:29.715644 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0206cfaa-8e2e-4a94-b765-5c0dfd32087c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:29.716575 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0206cfaa-8e2e-4a94-b765-5c0dfd32087c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:29.717222 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0206cfaa-8e2e-4a94-b765-5c0dfd32087c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:29.717647 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0206cfaa-8e2e-4a94-b765-5c0dfd32087c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:29.912986 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0206cfaa-8e2e-4a94-b765-5c0dfd32087c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:29.926791 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0206cfaa-8e2e-4a94-b765-5c0dfd32087c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1241 microversion: 2.1 time: 0.226417 Sep 01 16:34:29.928393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 50/88] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:29 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1241 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:30.324568 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f6571ae4-a8c9-4d9e-98df-ee62c6a4f113 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:30.325387 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f6571ae4-a8c9-4d9e-98df-ee62c6a4f113 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:30.333627 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f6571ae4-a8c9-4d9e-98df-ee62c6a4f113 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.334118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f6571ae4-a8c9-4d9e-98df-ee62c6a4f113 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.334575 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f6571ae4-a8c9-4d9e-98df-ee62c6a4f113 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:30.335325 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f6571ae4-a8c9-4d9e-98df-ee62c6a4f113 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.335787 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f6571ae4-a8c9-4d9e-98df-ee62c6a4f113 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.336211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f6571ae4-a8c9-4d9e-98df-ee62c6a4f113 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:30.521901 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4e4cb92f-dfa5-4ba5-b4ba-08ad692cd539 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:30.523600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4e4cb92f-dfa5-4ba5-b4ba-08ad692cd539 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:30.531399 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e4cb92f-dfa5-4ba5-b4ba-08ad692cd539 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.532188 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e4cb92f-dfa5-4ba5-b4ba-08ad692cd539 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.532922 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e4cb92f-dfa5-4ba5-b4ba-08ad692cd539 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:30.533933 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e4cb92f-dfa5-4ba5-b4ba-08ad692cd539 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.534700 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e4cb92f-dfa5-4ba5-b4ba-08ad692cd539 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.535271 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e4cb92f-dfa5-4ba5-b4ba-08ad692cd539 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:30.547165 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f6571ae4-a8c9-4d9e-98df-ee62c6a4f113 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:30.555348 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f6571ae4-a8c9-4d9e-98df-ee62c6a4f113 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.252346 Sep 01 16:34:30.556286 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 39/89] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:30 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:30.587644 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-734006b5-95c7-4128-a0d5-98de1b3438df tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:30.588388 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-734006b5-95c7-4128-a0d5-98de1b3438df tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:30.594881 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-734006b5-95c7-4128-a0d5-98de1b3438df tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.595484 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-734006b5-95c7-4128-a0d5-98de1b3438df tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.595983 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-734006b5-95c7-4128-a0d5-98de1b3438df tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:30.596749 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-734006b5-95c7-4128-a0d5-98de1b3438df tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.597334 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-734006b5-95c7-4128-a0d5-98de1b3438df tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.597808 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-734006b5-95c7-4128-a0d5-98de1b3438df tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:30.628210 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4e4cb92f-dfa5-4ba5-b4ba-08ad692cd539 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:30.639243 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4e4cb92f-dfa5-4ba5-b4ba-08ad692cd539 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:30.641100 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4e4cb92f-dfa5-4ba5-b4ba-08ad692cd539 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:30.642515 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4e4cb92f-dfa5-4ba5-b4ba-08ad692cd539 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1334 microversion: 2.20 time: 0.124901 Sep 01 16:34:30.655031 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 51/90] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:30 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1334 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:30.699961 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-734006b5-95c7-4128-a0d5-98de1b3438df tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:30.704342 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=100 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:30.711395 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-734006b5-95c7-4128-a0d5-98de1b3438df tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1226 microversion: 2.1 time: 0.128729 Sep 01 16:34:30.712580 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 40/91] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:30 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1226 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:30.949841 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e2dcd1b4-cb09-44e8-be7a-ed8afd677b13 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:30.950461 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e2dcd1b4-cb09-44e8-be7a-ed8afd677b13 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:30.956348 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2dcd1b4-cb09-44e8-be7a-ed8afd677b13 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.956790 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2dcd1b4-cb09-44e8-be7a-ed8afd677b13 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.957212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2dcd1b4-cb09-44e8-be7a-ed8afd677b13 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:30.957889 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2dcd1b4-cb09-44e8-be7a-ed8afd677b13 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.958363 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2dcd1b4-cb09-44e8-be7a-ed8afd677b13 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.958763 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2dcd1b4-cb09-44e8-be7a-ed8afd677b13 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:30.993443 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=4 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:31.020921 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e2dcd1b4-cb09-44e8-be7a-ed8afd677b13 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:31.029008 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e2dcd1b4-cb09-44e8-be7a-ed8afd677b13 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1241 microversion: 2.1 time: 0.083533 Sep 01 16:34:31.029564 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 52/92] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:30 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:31.595425 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-de13ec95-0952-4114-8c41-fd45dd71f70b tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:31.595425 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-de13ec95-0952-4114-8c41-fd45dd71f70b tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:31.599460 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de13ec95-0952-4114-8c41-fd45dd71f70b tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:31.599934 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de13ec95-0952-4114-8c41-fd45dd71f70b tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:31.600356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de13ec95-0952-4114-8c41-fd45dd71f70b tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:31.601042 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de13ec95-0952-4114-8c41-fd45dd71f70b tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:31.601483 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de13ec95-0952-4114-8c41-fd45dd71f70b tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:31.601897 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de13ec95-0952-4114-8c41-fd45dd71f70b tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:31.666354 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-254e9943-4207-41ea-bb2e-9e4e3da8ffae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:31.668187 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-254e9943-4207-41ea-bb2e-9e4e3da8ffae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:31.674552 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-254e9943-4207-41ea-bb2e-9e4e3da8ffae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:31.675025 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-254e9943-4207-41ea-bb2e-9e4e3da8ffae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:31.675456 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-254e9943-4207-41ea-bb2e-9e4e3da8ffae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:31.676143 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-254e9943-4207-41ea-bb2e-9e4e3da8ffae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:31.676610 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-254e9943-4207-41ea-bb2e-9e4e3da8ffae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:31.676995 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-254e9943-4207-41ea-bb2e-9e4e3da8ffae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:31.739119 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-de13ec95-0952-4114-8c41-fd45dd71f70b tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:31.747795 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-254e9943-4207-41ea-bb2e-9e4e3da8ffae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:31.751309 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-de13ec95-0952-4114-8c41-fd45dd71f70b tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.163093 Sep 01 16:34:31.756154 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-254e9943-4207-41ea-bb2e-9e4e3da8ffae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:31.757992 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-254e9943-4207-41ea-bb2e-9e4e3da8ffae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:31.759102 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-254e9943-4207-41ea-bb2e-9e4e3da8ffae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1334 microversion: 2.20 time: 0.096977 Sep 01 16:34:31.759637 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 53/93] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:31 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1334 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:31.764069 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bb76a9e9-63d1-42a3-b57d-2c526eeed6b5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:31.764657 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bb76a9e9-63d1-42a3-b57d-2c526eeed6b5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:31.766804 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 41/94] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:31 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:31.770971 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb76a9e9-63d1-42a3-b57d-2c526eeed6b5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:31.771436 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb76a9e9-63d1-42a3-b57d-2c526eeed6b5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:31.772044 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb76a9e9-63d1-42a3-b57d-2c526eeed6b5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:31.772733 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb76a9e9-63d1-42a3-b57d-2c526eeed6b5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:31.773168 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb76a9e9-63d1-42a3-b57d-2c526eeed6b5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:31.773811 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb76a9e9-63d1-42a3-b57d-2c526eeed6b5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:31.840917 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bb76a9e9-63d1-42a3-b57d-2c526eeed6b5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:31.850637 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bb76a9e9-63d1-42a3-b57d-2c526eeed6b5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1226 microversion: 2.1 time: 0.089946 Sep 01 16:34:31.851607 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 54/95] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:31 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:32.048814 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-81dfb95d-f4d3-4257-9a9c-5284522fdb90 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:32.049486 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-81dfb95d-f4d3-4257-9a9c-5284522fdb90 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:32.051278 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=22 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:32.056570 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-81dfb95d-f4d3-4257-9a9c-5284522fdb90 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:32.057054 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-81dfb95d-f4d3-4257-9a9c-5284522fdb90 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:32.057486 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-81dfb95d-f4d3-4257-9a9c-5284522fdb90 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:32.058188 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-81dfb95d-f4d3-4257-9a9c-5284522fdb90 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:32.058654 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-81dfb95d-f4d3-4257-9a9c-5284522fdb90 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:32.059068 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-81dfb95d-f4d3-4257-9a9c-5284522fdb90 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:32.123379 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-81dfb95d-f4d3-4257-9a9c-5284522fdb90 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:32.131685 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-81dfb95d-f4d3-4257-9a9c-5284522fdb90 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1241 microversion: 2.1 time: 0.086534 Sep 01 16:34:32.132725 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 42/96] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:32 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:32.773265 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0d9686c9-5d44-4097-ad42-314e99cd0ac0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:32.774209 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0d9686c9-5d44-4097-ad42-314e99cd0ac0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:32.778410 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=8 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:32.782408 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e58b5f38-9432-4df9-8fed-00b082ea46ea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:32.783113 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d9686c9-5d44-4097-ad42-314e99cd0ac0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:32.783488 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-e58b5f38-9432-4df9-8fed-00b082ea46ea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:32.783596 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d9686c9-5d44-4097-ad42-314e99cd0ac0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:32.784019 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d9686c9-5d44-4097-ad42-314e99cd0ac0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:32.784725 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d9686c9-5d44-4097-ad42-314e99cd0ac0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:32.785178 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d9686c9-5d44-4097-ad42-314e99cd0ac0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:32.785628 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d9686c9-5d44-4097-ad42-314e99cd0ac0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:32.791456 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e58b5f38-9432-4df9-8fed-00b082ea46ea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:32.792045 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e58b5f38-9432-4df9-8fed-00b082ea46ea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:32.792704 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e58b5f38-9432-4df9-8fed-00b082ea46ea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:32.793618 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e58b5f38-9432-4df9-8fed-00b082ea46ea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:32.794134 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e58b5f38-9432-4df9-8fed-00b082ea46ea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:32.794654 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e58b5f38-9432-4df9-8fed-00b082ea46ea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:32.806392 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=24 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:32.998471 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e58b5f38-9432-4df9-8fed-00b082ea46ea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:33.033494 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e58b5f38-9432-4df9-8fed-00b082ea46ea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:33.036354 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e58b5f38-9432-4df9-8fed-00b082ea46ea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:33.039910 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-e58b5f38-9432-4df9-8fed-00b082ea46ea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1342 microversion: 2.20 time: 0.262359 Sep 01 16:34:33.045152 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 43/97] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:32 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1342 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:33.075077 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-fefba1d1-57bf-4667-8307-ddb2f79f9966 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:33.077297 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-fefba1d1-57bf-4667-8307-ddb2f79f9966 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:33.093200 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fefba1d1-57bf-4667-8307-ddb2f79f9966 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:33.093200 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fefba1d1-57bf-4667-8307-ddb2f79f9966 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:33.093200 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fefba1d1-57bf-4667-8307-ddb2f79f9966 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:33.093200 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fefba1d1-57bf-4667-8307-ddb2f79f9966 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:33.093497 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fefba1d1-57bf-4667-8307-ddb2f79f9966 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:33.093497 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fefba1d1-57bf-4667-8307-ddb2f79f9966 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:33.154092 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0d9686c9-5d44-4097-ad42-314e99cd0ac0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:33.175093 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0d9686c9-5d44-4097-ad42-314e99cd0ac0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.406342 Sep 01 16:34:33.175718 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 55/98] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:32 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:33.181176 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cf8cb18e-ea39-4f7f-8de7-5a10ae49ae15 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:33.182075 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cf8cb18e-ea39-4f7f-8de7-5a10ae49ae15 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:33.194039 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cf8cb18e-ea39-4f7f-8de7-5a10ae49ae15 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:33.194807 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cf8cb18e-ea39-4f7f-8de7-5a10ae49ae15 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:33.195523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cf8cb18e-ea39-4f7f-8de7-5a10ae49ae15 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:33.196516 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cf8cb18e-ea39-4f7f-8de7-5a10ae49ae15 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:33.198707 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cf8cb18e-ea39-4f7f-8de7-5a10ae49ae15 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:33.199227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cf8cb18e-ea39-4f7f-8de7-5a10ae49ae15 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:33.286110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-fefba1d1-57bf-4667-8307-ddb2f79f9966 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:33.295525 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-fefba1d1-57bf-4667-8307-ddb2f79f9966 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1274 microversion: 2.1 time: 0.230072 Sep 01 16:34:33.296299 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 44/99] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:33 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1274 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:33.323524 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cf8cb18e-ea39-4f7f-8de7-5a10ae49ae15 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:33.331540 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cf8cb18e-ea39-4f7f-8de7-5a10ae49ae15 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1289 microversion: 2.1 time: 0.154583 Sep 01 16:34:33.332296 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 56/100] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:33 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1289 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:33.772456 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-9364ebfd-3bd4-4c58-8b47-4286614f09b1 req-9effb553-c080-4f0d-a092-c073b01badde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13e447e7-8805-447e-8cf9-7771733bf00f", "tag": "871bccd9-3596-40d8-8c9a-f29d5ba58a45"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:33.779807 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:33.788133 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-9364ebfd-3bd4-4c58-8b47-4286614f09b1 req-9effb553-c080-4f0d-a092-c073b01badde service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:33.789390 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-9364ebfd-3bd4-4c58-8b47-4286614f09b1 req-9effb553-c080-4f0d-a092-c073b01badde service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:33.789837 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-9364ebfd-3bd4-4c58-8b47-4286614f09b1 req-9effb553-c080-4f0d-a092-c073b01badde service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:33.802842 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-9364ebfd-3bd4-4c58-8b47-4286614f09b1 req-9effb553-c080-4f0d-a092-c073b01badde service nova] Creating event network-changed:871bccd9-3596-40d8-8c9a-f29d5ba58a45 for instance 13e447e7-8805-447e-8cf9-7771733bf00f on hv-cinder-85220 Sep 01 16:34:33.808519 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-9364ebfd-3bd4-4c58-8b47-4286614f09b1 req-9effb553-c080-4f0d-a092-c073b01badde service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122587 Sep 01 16:34:33.809108 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 45/101] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:34.072031 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bb3aa9a9-0c6b-467a-bc4b-70e0d8ecd469 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:34.072565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bb3aa9a9-0c6b-467a-bc4b-70e0d8ecd469 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:34.078521 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb3aa9a9-0c6b-467a-bc4b-70e0d8ecd469 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:34.079001 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb3aa9a9-0c6b-467a-bc4b-70e0d8ecd469 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:34.079432 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb3aa9a9-0c6b-467a-bc4b-70e0d8ecd469 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:34.080159 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb3aa9a9-0c6b-467a-bc4b-70e0d8ecd469 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:34.080613 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb3aa9a9-0c6b-467a-bc4b-70e0d8ecd469 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:34.081033 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb3aa9a9-0c6b-467a-bc4b-70e0d8ecd469 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:34.144539 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bb3aa9a9-0c6b-467a-bc4b-70e0d8ecd469 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:34.153417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bb3aa9a9-0c6b-467a-bc4b-70e0d8ecd469 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:34.154907 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bb3aa9a9-0c6b-467a-bc4b-70e0d8ecd469 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:34.155998 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bb3aa9a9-0c6b-467a-bc4b-70e0d8ecd469 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1340 microversion: 2.20 time: 0.087985 Sep 01 16:34:34.156544 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 57/102] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:34 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1340 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:34.197228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-fc85c81d-aa9e-4d49-b293-135ba40c1454 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:34.198658 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-fc85c81d-aa9e-4d49-b293-135ba40c1454 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:34.207581 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fc85c81d-aa9e-4d49-b293-135ba40c1454 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:34.208212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fc85c81d-aa9e-4d49-b293-135ba40c1454 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:34.208744 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fc85c81d-aa9e-4d49-b293-135ba40c1454 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:34.209549 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fc85c81d-aa9e-4d49-b293-135ba40c1454 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:34.210124 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fc85c81d-aa9e-4d49-b293-135ba40c1454 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:34.210663 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fc85c81d-aa9e-4d49-b293-135ba40c1454 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:34.316481 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-46c040e0-9cd2-44e2-83df-d3f68a1ea833 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:34.317080 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-46c040e0-9cd2-44e2-83df-d3f68a1ea833 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:34.323025 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46c040e0-9cd2-44e2-83df-d3f68a1ea833 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:34.323960 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46c040e0-9cd2-44e2-83df-d3f68a1ea833 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:34.324385 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46c040e0-9cd2-44e2-83df-d3f68a1ea833 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:34.325069 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46c040e0-9cd2-44e2-83df-d3f68a1ea833 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:34.325691 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46c040e0-9cd2-44e2-83df-d3f68a1ea833 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:34.326109 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46c040e0-9cd2-44e2-83df-d3f68a1ea833 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:34.392538 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-46c040e0-9cd2-44e2-83df-d3f68a1ea833 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:34.400271 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-46c040e0-9cd2-44e2-83df-d3f68a1ea833 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1282 microversion: 2.1 time: 0.087727 Sep 01 16:34:34.400860 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 58/103] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:34 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1282 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:34.407136 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c223439d-3cb8-473b-acf0-b0750cd03dbd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:34.407745 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c223439d-3cb8-473b-acf0-b0750cd03dbd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:34.410976 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-fc85c81d-aa9e-4d49-b293-135ba40c1454 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:34.418741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-fc85c81d-aa9e-4d49-b293-135ba40c1454 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.226501 Sep 01 16:34:34.419321 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 46/104] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:34 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:34.432469 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c223439d-3cb8-473b-acf0-b0750cd03dbd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:34.433117 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c223439d-3cb8-473b-acf0-b0750cd03dbd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:34.433573 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c223439d-3cb8-473b-acf0-b0750cd03dbd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:34.434307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c223439d-3cb8-473b-acf0-b0750cd03dbd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:34.434778 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c223439d-3cb8-473b-acf0-b0750cd03dbd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:34.435214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c223439d-3cb8-473b-acf0-b0750cd03dbd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:34.498792 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c223439d-3cb8-473b-acf0-b0750cd03dbd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:34.506430 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c223439d-3cb8-473b-acf0-b0750cd03dbd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1297 microversion: 2.1 time: 0.103951 Sep 01 16:34:34.507000 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 59/105] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:34 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1297 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:35.179200 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b2c9620d-b6eb-40b8-8dc3-67a1a9206167 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:35.179746 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b2c9620d-b6eb-40b8-8dc3-67a1a9206167 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:35.187134 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b2c9620d-b6eb-40b8-8dc3-67a1a9206167 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:35.187609 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b2c9620d-b6eb-40b8-8dc3-67a1a9206167 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:35.188033 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b2c9620d-b6eb-40b8-8dc3-67a1a9206167 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:35.188711 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b2c9620d-b6eb-40b8-8dc3-67a1a9206167 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:35.189157 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b2c9620d-b6eb-40b8-8dc3-67a1a9206167 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:35.189573 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b2c9620d-b6eb-40b8-8dc3-67a1a9206167 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:35.357615 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b2c9620d-b6eb-40b8-8dc3-67a1a9206167 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:35.365701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b2c9620d-b6eb-40b8-8dc3-67a1a9206167 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:35.367122 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b2c9620d-b6eb-40b8-8dc3-67a1a9206167 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:35.368214 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b2c9620d-b6eb-40b8-8dc3-67a1a9206167 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.192961 Sep 01 16:34:35.368906 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 47/106] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:35 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:35.421441 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-793d7c69-15e3-4efa-b58e-de0ee6335ca6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:35.422133 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-793d7c69-15e3-4efa-b58e-de0ee6335ca6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:35.430993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-793d7c69-15e3-4efa-b58e-de0ee6335ca6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:35.431504 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-793d7c69-15e3-4efa-b58e-de0ee6335ca6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:35.432024 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-793d7c69-15e3-4efa-b58e-de0ee6335ca6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:35.432851 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-793d7c69-15e3-4efa-b58e-de0ee6335ca6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:35.433339 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-793d7c69-15e3-4efa-b58e-de0ee6335ca6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:35.433811 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-793d7c69-15e3-4efa-b58e-de0ee6335ca6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:35.439709 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c45498a6-2152-43aa-adcd-227e6f488fcd tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:35.440306 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c45498a6-2152-43aa-adcd-227e6f488fcd tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:35.446567 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c45498a6-2152-43aa-adcd-227e6f488fcd tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:35.447038 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c45498a6-2152-43aa-adcd-227e6f488fcd tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:35.447497 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c45498a6-2152-43aa-adcd-227e6f488fcd tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:35.448243 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c45498a6-2152-43aa-adcd-227e6f488fcd tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:35.448685 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c45498a6-2152-43aa-adcd-227e6f488fcd tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:35.449100 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c45498a6-2152-43aa-adcd-227e6f488fcd tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:35.497572 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-793d7c69-15e3-4efa-b58e-de0ee6335ca6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:35.505287 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-793d7c69-15e3-4efa-b58e-de0ee6335ca6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1282 microversion: 2.1 time: 0.088358 Sep 01 16:34:35.505855 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 60/107] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:35 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1282 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:35.528251 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f7aedbb5-1b38-478c-82f7-f6fce9b67ceb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:35.528850 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f7aedbb5-1b38-478c-82f7-f6fce9b67ceb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:35.535039 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7aedbb5-1b38-478c-82f7-f6fce9b67ceb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:35.535718 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7aedbb5-1b38-478c-82f7-f6fce9b67ceb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:35.536151 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7aedbb5-1b38-478c-82f7-f6fce9b67ceb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:35.536842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7aedbb5-1b38-478c-82f7-f6fce9b67ceb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:35.537288 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7aedbb5-1b38-478c-82f7-f6fce9b67ceb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:35.537716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7aedbb5-1b38-478c-82f7-f6fce9b67ceb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:35.577411 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c45498a6-2152-43aa-adcd-227e6f488fcd tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:35.585254 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c45498a6-2152-43aa-adcd-227e6f488fcd tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.149322 Sep 01 16:34:35.585825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 48/108] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:35 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:35.598604 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f7aedbb5-1b38-478c-82f7-f6fce9b67ceb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:35.606674 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f7aedbb5-1b38-478c-82f7-f6fce9b67ceb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1297 microversion: 2.1 time: 0.082679 Sep 01 16:34:35.607222 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 61/109] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:35 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:36.391174 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6a8a96cc-8c21-432f-aeb0-d72a9116e300 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:36.391782 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-6a8a96cc-8c21-432f-aeb0-d72a9116e300 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:36.397833 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a8a96cc-8c21-432f-aeb0-d72a9116e300 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:36.398339 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a8a96cc-8c21-432f-aeb0-d72a9116e300 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:36.398773 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a8a96cc-8c21-432f-aeb0-d72a9116e300 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:36.399453 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a8a96cc-8c21-432f-aeb0-d72a9116e300 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:36.399902 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a8a96cc-8c21-432f-aeb0-d72a9116e300 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:36.400354 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a8a96cc-8c21-432f-aeb0-d72a9116e300 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:36.524924 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d2e2dc20-c4d7-4fe1-b699-6f902c6df658 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:36.525534 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d2e2dc20-c4d7-4fe1-b699-6f902c6df658 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:36.530690 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-6a8a96cc-8c21-432f-aeb0-d72a9116e300 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:36.531812 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2e2dc20-c4d7-4fe1-b699-6f902c6df658 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:36.532299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2e2dc20-c4d7-4fe1-b699-6f902c6df658 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:36.532735 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2e2dc20-c4d7-4fe1-b699-6f902c6df658 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:36.533427 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2e2dc20-c4d7-4fe1-b699-6f902c6df658 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:36.534041 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2e2dc20-c4d7-4fe1-b699-6f902c6df658 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:36.534640 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2e2dc20-c4d7-4fe1-b699-6f902c6df658 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:36.538856 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-6a8a96cc-8c21-432f-aeb0-d72a9116e300 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:36.540306 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-6a8a96cc-8c21-432f-aeb0-d72a9116e300 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:36.541461 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-6a8a96cc-8c21-432f-aeb0-d72a9116e300 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.154181 Sep 01 16:34:36.542558 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 49/110] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:36 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:36.594309 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d2e2dc20-c4d7-4fe1-b699-6f902c6df658 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:36.601927 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d2e2dc20-c4d7-4fe1-b699-6f902c6df658 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1282 microversion: 2.1 time: 0.080853 Sep 01 16:34:36.602640 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 62/111] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:36 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1282 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:36.606355 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-03ad2ffd-0726-43af-96db-d3ad2de67a69 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:36.606950 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-03ad2ffd-0726-43af-96db-d3ad2de67a69 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:36.612659 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-03ad2ffd-0726-43af-96db-d3ad2de67a69 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:36.613125 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-03ad2ffd-0726-43af-96db-d3ad2de67a69 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:36.613545 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-03ad2ffd-0726-43af-96db-d3ad2de67a69 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:36.614209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-03ad2ffd-0726-43af-96db-d3ad2de67a69 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:36.614671 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-03ad2ffd-0726-43af-96db-d3ad2de67a69 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:36.615081 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-03ad2ffd-0726-43af-96db-d3ad2de67a69 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:36.626791 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-71923783-e25f-4d52-adc8-8149611d5522 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:36.627398 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-71923783-e25f-4d52-adc8-8149611d5522 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:36.633303 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71923783-e25f-4d52-adc8-8149611d5522 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:36.633781 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71923783-e25f-4d52-adc8-8149611d5522 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:36.634202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71923783-e25f-4d52-adc8-8149611d5522 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:36.634900 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71923783-e25f-4d52-adc8-8149611d5522 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:36.635345 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71923783-e25f-4d52-adc8-8149611d5522 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:36.635755 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71923783-e25f-4d52-adc8-8149611d5522 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:36.695945 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-71923783-e25f-4d52-adc8-8149611d5522 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:36.704290 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-71923783-e25f-4d52-adc8-8149611d5522 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1297 microversion: 2.1 time: 0.081080 Sep 01 16:34:36.705000 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 63/112] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:36 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1297 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:36.748384 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-03ad2ffd-0726-43af-96db-d3ad2de67a69 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:36.756264 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-03ad2ffd-0726-43af-96db-d3ad2de67a69 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.154093 Sep 01 16:34:36.756836 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 50/113] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:36 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:37.566532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-88a0bc92-5d34-45e1-95a0-10f0c4ee2579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:37.568190 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-88a0bc92-5d34-45e1-95a0-10f0c4ee2579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:37.575271 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-88a0bc92-5d34-45e1-95a0-10f0c4ee2579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:37.576468 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-88a0bc92-5d34-45e1-95a0-10f0c4ee2579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:37.577135 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-88a0bc92-5d34-45e1-95a0-10f0c4ee2579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:37.578568 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-88a0bc92-5d34-45e1-95a0-10f0c4ee2579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:37.579196 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-88a0bc92-5d34-45e1-95a0-10f0c4ee2579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:37.579625 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-88a0bc92-5d34-45e1-95a0-10f0c4ee2579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:37.623515 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-0ece1082-02e9-4cf9-a9cc-be39baab3fa5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:37.624173 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0ece1082-02e9-4cf9-a9cc-be39baab3fa5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:37.632376 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0ece1082-02e9-4cf9-a9cc-be39baab3fa5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:37.632863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0ece1082-02e9-4cf9-a9cc-be39baab3fa5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:37.633548 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0ece1082-02e9-4cf9-a9cc-be39baab3fa5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:37.634821 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0ece1082-02e9-4cf9-a9cc-be39baab3fa5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:37.635280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0ece1082-02e9-4cf9-a9cc-be39baab3fa5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:37.635730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0ece1082-02e9-4cf9-a9cc-be39baab3fa5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:37.724667 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0ece1082-02e9-4cf9-a9cc-be39baab3fa5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:37.735328 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-0ece1082-02e9-4cf9-a9cc-be39baab3fa5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1280 microversion: 2.1 time: 0.115954 Sep 01 16:34:37.738752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 51/114] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:37 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1280 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:37.747210 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-bdff2400-9011-4df7-b8b1-26fb6feb2365 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:37.748023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-bdff2400-9011-4df7-b8b1-26fb6feb2365 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:37.754583 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bdff2400-9011-4df7-b8b1-26fb6feb2365 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:37.755475 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bdff2400-9011-4df7-b8b1-26fb6feb2365 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:37.755921 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bdff2400-9011-4df7-b8b1-26fb6feb2365 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:37.756622 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bdff2400-9011-4df7-b8b1-26fb6feb2365 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:37.757061 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bdff2400-9011-4df7-b8b1-26fb6feb2365 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:37.757661 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bdff2400-9011-4df7-b8b1-26fb6feb2365 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:37.832083 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-88a0bc92-5d34-45e1-95a0-10f0c4ee2579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:37.844324 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-88a0bc92-5d34-45e1-95a0-10f0c4ee2579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:37.846485 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-88a0bc92-5d34-45e1-95a0-10f0c4ee2579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:37.847910 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-88a0bc92-5d34-45e1-95a0-10f0c4ee2579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.287037 Sep 01 16:34:37.848925 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 64/115] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:37 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:37.854067 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e2cb5c45-6b29-428b-8f80-0479f156a2e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:37.855671 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e2cb5c45-6b29-428b-8f80-0479f156a2e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:37.870154 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2cb5c45-6b29-428b-8f80-0479f156a2e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:37.871108 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2cb5c45-6b29-428b-8f80-0479f156a2e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:37.871108 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2cb5c45-6b29-428b-8f80-0479f156a2e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:37.871793 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2cb5c45-6b29-428b-8f80-0479f156a2e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:37.872244 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2cb5c45-6b29-428b-8f80-0479f156a2e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:37.872663 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2cb5c45-6b29-428b-8f80-0479f156a2e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:37.908916 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-bdff2400-9011-4df7-b8b1-26fb6feb2365 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:37.920429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-bdff2400-9011-4df7-b8b1-26fb6feb2365 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1295 microversion: 2.1 time: 0.180373 Sep 01 16:34:37.921319 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 52/116] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:37 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1295 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:38.017403 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e2cb5c45-6b29-428b-8f80-0479f156a2e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:38.025726 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e2cb5c45-6b29-428b-8f80-0479f156a2e8 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.175534 Sep 01 16:34:38.026938 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 65/117] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:37 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:38.070667 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-de2d914c-b951-46b3-8b29-cd90bfa1cbdd req-7df2af79-7cdf-4c85-b0e7-7d79e310a320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0958ba3f-7f1d-4fa1-bff7-4459d3945b6f", "tag": "46daf8ff-8552-45e4-b4ac-b60b47e199de"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:38.080775 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-de2d914c-b951-46b3-8b29-cd90bfa1cbdd req-7df2af79-7cdf-4c85-b0e7-7d79e310a320 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:38.081249 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-de2d914c-b951-46b3-8b29-cd90bfa1cbdd req-7df2af79-7cdf-4c85-b0e7-7d79e310a320 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:38.081675 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-de2d914c-b951-46b3-8b29-cd90bfa1cbdd req-7df2af79-7cdf-4c85-b0e7-7d79e310a320 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:38.094888 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-de2d914c-b951-46b3-8b29-cd90bfa1cbdd req-7df2af79-7cdf-4c85-b0e7-7d79e310a320 service nova] Creating event network-changed:46daf8ff-8552-45e4-b4ac-b60b47e199de for instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f on hv-cinder-85220 Sep 01 16:34:38.099818 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-de2d914c-b951-46b3-8b29-cd90bfa1cbdd req-7df2af79-7cdf-4c85-b0e7-7d79e310a320 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032877 Sep 01 16:34:38.100420 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 53/118] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:38.761763 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b440aa17-3512-401d-a3fc-7789fb47c3ca tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:38.762387 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b440aa17-3512-401d-a3fc-7789fb47c3ca tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:38.768489 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b440aa17-3512-401d-a3fc-7789fb47c3ca tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:38.768830 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b440aa17-3512-401d-a3fc-7789fb47c3ca tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:38.769205 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b440aa17-3512-401d-a3fc-7789fb47c3ca tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:38.769982 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b440aa17-3512-401d-a3fc-7789fb47c3ca tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:38.770478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b440aa17-3512-401d-a3fc-7789fb47c3ca tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:38.770893 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b440aa17-3512-401d-a3fc-7789fb47c3ca tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:38.789266 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:38.832129 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b440aa17-3512-401d-a3fc-7789fb47c3ca tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:38.840373 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b440aa17-3512-401d-a3fc-7789fb47c3ca tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1280 microversion: 2.1 time: 0.082925 Sep 01 16:34:38.840926 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 66/119] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:38 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:38.876363 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-bde3c826-300f-41c8-8a98-07acc87b2a1b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:38.877170 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-bde3c826-300f-41c8-8a98-07acc87b2a1b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:38.883276 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bde3c826-300f-41c8-8a98-07acc87b2a1b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:38.883750 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bde3c826-300f-41c8-8a98-07acc87b2a1b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:38.884167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bde3c826-300f-41c8-8a98-07acc87b2a1b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:38.884843 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bde3c826-300f-41c8-8a98-07acc87b2a1b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:38.885291 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bde3c826-300f-41c8-8a98-07acc87b2a1b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:38.886270 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bde3c826-300f-41c8-8a98-07acc87b2a1b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:38.941004 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8fabd17e-f98e-4b5a-8d05-fc7f7beabcf5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:38.941597 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8fabd17e-f98e-4b5a-8d05-fc7f7beabcf5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:38.947454 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8fabd17e-f98e-4b5a-8d05-fc7f7beabcf5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:38.948452 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8fabd17e-f98e-4b5a-8d05-fc7f7beabcf5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:38.948876 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8fabd17e-f98e-4b5a-8d05-fc7f7beabcf5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:38.949563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8fabd17e-f98e-4b5a-8d05-fc7f7beabcf5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:38.949984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8fabd17e-f98e-4b5a-8d05-fc7f7beabcf5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:38.950420 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8fabd17e-f98e-4b5a-8d05-fc7f7beabcf5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:39.012101 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8fabd17e-f98e-4b5a-8d05-fc7f7beabcf5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:39.019556 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8fabd17e-f98e-4b5a-8d05-fc7f7beabcf5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1295 microversion: 2.1 time: 0.082391 Sep 01 16:34:39.020128 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 67/120] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:38 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1295 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:39.029472 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-bde3c826-300f-41c8-8a98-07acc87b2a1b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:39.037511 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-bde3c826-300f-41c8-8a98-07acc87b2a1b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:39.038972 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-bde3c826-300f-41c8-8a98-07acc87b2a1b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:39.040131 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-bde3c826-300f-41c8-8a98-07acc87b2a1b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.167853 Sep 01 16:34:39.040638 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 54/121] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:38 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:39.053710 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-31abd615-022c-4531-909c-208613720ea7 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:39.053710 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-31abd615-022c-4531-909c-208613720ea7 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:39.059850 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31abd615-022c-4531-909c-208613720ea7 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:39.060321 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31abd615-022c-4531-909c-208613720ea7 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:39.060746 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31abd615-022c-4531-909c-208613720ea7 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:39.061417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31abd615-022c-4531-909c-208613720ea7 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:39.061854 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31abd615-022c-4531-909c-208613720ea7 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:39.062315 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31abd615-022c-4531-909c-208613720ea7 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:39.190198 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-31abd615-022c-4531-909c-208613720ea7 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:39.198793 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-31abd615-022c-4531-909c-208613720ea7 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.148938 Sep 01 16:34:39.199360 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 68/122] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:39 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:39.861327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-add176ed-9633-4e28-ab51-9ae550596fa2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:39.861982 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-add176ed-9633-4e28-ab51-9ae550596fa2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:39.867906 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-add176ed-9633-4e28-ab51-9ae550596fa2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:39.868380 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-add176ed-9633-4e28-ab51-9ae550596fa2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:39.868803 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-add176ed-9633-4e28-ab51-9ae550596fa2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:39.869478 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-add176ed-9633-4e28-ab51-9ae550596fa2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:39.869920 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-add176ed-9633-4e28-ab51-9ae550596fa2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:39.870495 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-add176ed-9633-4e28-ab51-9ae550596fa2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:39.936332 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-add176ed-9633-4e28-ab51-9ae550596fa2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:39.944133 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-add176ed-9633-4e28-ab51-9ae550596fa2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1280 microversion: 2.1 time: 0.086614 Sep 01 16:34:39.944688 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 55/123] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:39 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:40.040628 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ceac8d9d-e97c-4a70-b03e-91c0cd4ed5a9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:40.041238 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ceac8d9d-e97c-4a70-b03e-91c0cd4ed5a9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:40.047809 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ceac8d9d-e97c-4a70-b03e-91c0cd4ed5a9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:40.048285 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ceac8d9d-e97c-4a70-b03e-91c0cd4ed5a9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:40.048697 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ceac8d9d-e97c-4a70-b03e-91c0cd4ed5a9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:40.049363 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ceac8d9d-e97c-4a70-b03e-91c0cd4ed5a9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:40.049830 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ceac8d9d-e97c-4a70-b03e-91c0cd4ed5a9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:40.050260 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ceac8d9d-e97c-4a70-b03e-91c0cd4ed5a9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:40.062899 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-2a3fc259-3907-47ea-b4ad-6d06179c4dad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:40.063498 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-2a3fc259-3907-47ea-b4ad-6d06179c4dad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:40.069337 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a3fc259-3907-47ea-b4ad-6d06179c4dad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:40.069886 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a3fc259-3907-47ea-b4ad-6d06179c4dad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:40.070363 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a3fc259-3907-47ea-b4ad-6d06179c4dad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:40.071062 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a3fc259-3907-47ea-b4ad-6d06179c4dad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:40.071550 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a3fc259-3907-47ea-b4ad-6d06179c4dad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:40.072011 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a3fc259-3907-47ea-b4ad-6d06179c4dad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:40.112445 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ceac8d9d-e97c-4a70-b03e-91c0cd4ed5a9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:40.120271 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ceac8d9d-e97c-4a70-b03e-91c0cd4ed5a9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1295 microversion: 2.1 time: 0.083381 Sep 01 16:34:40.120845 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 69/124] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:40 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:40.205758 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2a3fc259-3907-47ea-b4ad-6d06179c4dad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:40.214465 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2a3fc259-3907-47ea-b4ad-6d06179c4dad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:40.216048 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2a3fc259-3907-47ea-b4ad-6d06179c4dad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:40.217365 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-2a3fc259-3907-47ea-b4ad-6d06179c4dad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.158439 Sep 01 16:34:40.218011 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 56/125] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:40 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:40.220682 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b9169b84-d94d-428e-802e-7a8f88d5be42 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:40.221291 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b9169b84-d94d-428e-802e-7a8f88d5be42 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:40.228274 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9169b84-d94d-428e-802e-7a8f88d5be42 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:40.228757 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9169b84-d94d-428e-802e-7a8f88d5be42 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:40.229215 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9169b84-d94d-428e-802e-7a8f88d5be42 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:40.230159 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9169b84-d94d-428e-802e-7a8f88d5be42 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:40.230645 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9169b84-d94d-428e-802e-7a8f88d5be42 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:40.231078 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9169b84-d94d-428e-802e-7a8f88d5be42 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:40.373043 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b9169b84-d94d-428e-802e-7a8f88d5be42 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:40.381009 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b9169b84-d94d-428e-802e-7a8f88d5be42 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.164467 Sep 01 16:34:40.381576 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 70/126] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:40 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:40.964534 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-1041fed2-2b7d-47ce-93af-3a2334becf59 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:40.965153 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-1041fed2-2b7d-47ce-93af-3a2334becf59 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:40.971065 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1041fed2-2b7d-47ce-93af-3a2334becf59 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:40.971535 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1041fed2-2b7d-47ce-93af-3a2334becf59 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:40.971962 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1041fed2-2b7d-47ce-93af-3a2334becf59 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:40.972664 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1041fed2-2b7d-47ce-93af-3a2334becf59 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:40.973107 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1041fed2-2b7d-47ce-93af-3a2334becf59 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:40.973519 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1041fed2-2b7d-47ce-93af-3a2334becf59 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:41.036696 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-1041fed2-2b7d-47ce-93af-3a2334becf59 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:41.045254 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-1041fed2-2b7d-47ce-93af-3a2334becf59 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1280 microversion: 2.1 time: 0.084559 Sep 01 16:34:41.046007 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 57/127] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:40 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:41.143042 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c97a5678-6200-4245-afa9-679dc0fb7249 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:41.143646 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c97a5678-6200-4245-afa9-679dc0fb7249 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:41.151366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c97a5678-6200-4245-afa9-679dc0fb7249 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:41.152204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c97a5678-6200-4245-afa9-679dc0fb7249 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:41.153144 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c97a5678-6200-4245-afa9-679dc0fb7249 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:41.154035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c97a5678-6200-4245-afa9-679dc0fb7249 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:41.154694 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c97a5678-6200-4245-afa9-679dc0fb7249 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:41.155293 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c97a5678-6200-4245-afa9-679dc0fb7249 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:41.244455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-062eb1e7-b439-4024-8e8b-6631389dab8a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:41.245721 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-062eb1e7-b439-4024-8e8b-6631389dab8a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:41.255905 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-062eb1e7-b439-4024-8e8b-6631389dab8a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:41.256623 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-062eb1e7-b439-4024-8e8b-6631389dab8a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:41.257210 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-062eb1e7-b439-4024-8e8b-6631389dab8a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:41.258496 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-062eb1e7-b439-4024-8e8b-6631389dab8a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:41.264152 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-062eb1e7-b439-4024-8e8b-6631389dab8a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:41.265711 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-062eb1e7-b439-4024-8e8b-6631389dab8a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:41.407652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c97a5678-6200-4245-afa9-679dc0fb7249 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:41.416135 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c97a5678-6200-4245-afa9-679dc0fb7249 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1295 microversion: 2.1 time: 0.277469 Sep 01 16:34:41.417389 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 71/128] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:41 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1295 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:41.444881 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8b06c5bc-2a86-411e-b911-972caf088c6e tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:41.445493 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8b06c5bc-2a86-411e-b911-972caf088c6e tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:41.456562 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b06c5bc-2a86-411e-b911-972caf088c6e tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:41.470918 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b06c5bc-2a86-411e-b911-972caf088c6e tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:41.471542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b06c5bc-2a86-411e-b911-972caf088c6e tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:41.472465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b06c5bc-2a86-411e-b911-972caf088c6e tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:41.473071 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b06c5bc-2a86-411e-b911-972caf088c6e tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:41.473639 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b06c5bc-2a86-411e-b911-972caf088c6e tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:41.936912 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8b06c5bc-2a86-411e-b911-972caf088c6e tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:41.954802 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8b06c5bc-2a86-411e-b911-972caf088c6e tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.519295 Sep 01 16:34:41.955621 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 72/129] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:41 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:42.068497 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2d4c9329-f0d3-4778-a220-7a084ef2b89a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:42.069408 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2d4c9329-f0d3-4778-a220-7a084ef2b89a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:42.076534 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d4c9329-f0d3-4778-a220-7a084ef2b89a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:42.077519 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d4c9329-f0d3-4778-a220-7a084ef2b89a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:42.078301 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d4c9329-f0d3-4778-a220-7a084ef2b89a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:42.079205 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d4c9329-f0d3-4778-a220-7a084ef2b89a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:42.079855 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d4c9329-f0d3-4778-a220-7a084ef2b89a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:42.080478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d4c9329-f0d3-4778-a220-7a084ef2b89a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:42.164344 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2d4c9329-f0d3-4778-a220-7a084ef2b89a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:42.174451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2d4c9329-f0d3-4778-a220-7a084ef2b89a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1280 microversion: 2.1 time: 0.111036 Sep 01 16:34:42.183358 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 73/130] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:42 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1280 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:42.284190 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-062eb1e7-b439-4024-8e8b-6631389dab8a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:42.289204 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=100 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:42.296382 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-062eb1e7-b439-4024-8e8b-6631389dab8a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:42.297963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-062eb1e7-b439-4024-8e8b-6631389dab8a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:42.299459 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-062eb1e7-b439-4024-8e8b-6631389dab8a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 1.059041 Sep 01 16:34:42.314563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 58/131] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:41 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:42.443224 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ea7b3797-ab71-414a-b9dd-e3dfc433e32a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:42.444099 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ea7b3797-ab71-414a-b9dd-e3dfc433e32a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:42.450762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea7b3797-ab71-414a-b9dd-e3dfc433e32a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:42.451834 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea7b3797-ab71-414a-b9dd-e3dfc433e32a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:42.452442 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea7b3797-ab71-414a-b9dd-e3dfc433e32a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:42.453308 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea7b3797-ab71-414a-b9dd-e3dfc433e32a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:42.453813 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea7b3797-ab71-414a-b9dd-e3dfc433e32a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:42.454482 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea7b3797-ab71-414a-b9dd-e3dfc433e32a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:42.528085 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ea7b3797-ab71-414a-b9dd-e3dfc433e32a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:42.541263 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ea7b3797-ab71-414a-b9dd-e3dfc433e32a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1295 microversion: 2.1 time: 0.102377 Sep 01 16:34:42.543091 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 74/132] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:42 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1295 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:42.978496 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c00f77bf-b1bf-4b76-814e-e84986544ba3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:42.980104 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c00f77bf-b1bf-4b76-814e-e84986544ba3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:42.985982 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c00f77bf-b1bf-4b76-814e-e84986544ba3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:42.986669 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c00f77bf-b1bf-4b76-814e-e84986544ba3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:42.987239 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c00f77bf-b1bf-4b76-814e-e84986544ba3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:42.988056 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c00f77bf-b1bf-4b76-814e-e84986544ba3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:42.989027 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c00f77bf-b1bf-4b76-814e-e84986544ba3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:42.989599 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c00f77bf-b1bf-4b76-814e-e84986544ba3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:43.198537 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-957b8809-0a8f-4a5b-aaa1-da82475333c2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:43.199237 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-957b8809-0a8f-4a5b-aaa1-da82475333c2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:43.211449 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-957b8809-0a8f-4a5b-aaa1-da82475333c2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:43.211948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-957b8809-0a8f-4a5b-aaa1-da82475333c2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:43.212373 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-957b8809-0a8f-4a5b-aaa1-da82475333c2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:43.213777 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-957b8809-0a8f-4a5b-aaa1-da82475333c2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:43.214267 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-957b8809-0a8f-4a5b-aaa1-da82475333c2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:43.214685 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-957b8809-0a8f-4a5b-aaa1-da82475333c2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:43.341791 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c00f77bf-b1bf-4b76-814e-e84986544ba3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:43.357954 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c00f77bf-b1bf-4b76-814e-e84986544ba3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.376825 Sep 01 16:34:43.357954 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 59/133] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:42 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:43.375049 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-23d22d2b-cc45-4983-b2a6-d04844699bbf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:43.376121 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-23d22d2b-cc45-4983-b2a6-d04844699bbf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:43.386933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-23d22d2b-cc45-4983-b2a6-d04844699bbf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:43.388310 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-23d22d2b-cc45-4983-b2a6-d04844699bbf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:43.389138 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-23d22d2b-cc45-4983-b2a6-d04844699bbf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:43.390291 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-23d22d2b-cc45-4983-b2a6-d04844699bbf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:43.390940 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-23d22d2b-cc45-4983-b2a6-d04844699bbf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:43.391861 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-23d22d2b-cc45-4983-b2a6-d04844699bbf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:43.466057 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-957b8809-0a8f-4a5b-aaa1-da82475333c2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:43.475231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-957b8809-0a8f-4a5b-aaa1-da82475333c2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.281586 Sep 01 16:34:43.480229 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 75/134] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:43 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:43.563674 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d0ab2940-e2c5-449c-ae40-3722ffce7ec3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:43.564279 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d0ab2940-e2c5-449c-ae40-3722ffce7ec3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:43.570095 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0ab2940-e2c5-449c-ae40-3722ffce7ec3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:43.570619 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0ab2940-e2c5-449c-ae40-3722ffce7ec3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:43.571049 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0ab2940-e2c5-449c-ae40-3722ffce7ec3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:43.571778 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0ab2940-e2c5-449c-ae40-3722ffce7ec3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:43.572177 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0ab2940-e2c5-449c-ae40-3722ffce7ec3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:43.572595 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0ab2940-e2c5-449c-ae40-3722ffce7ec3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:43.623183 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-23d22d2b-cc45-4983-b2a6-d04844699bbf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:43.632694 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-23d22d2b-cc45-4983-b2a6-d04844699bbf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:43.634504 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-23d22d2b-cc45-4983-b2a6-d04844699bbf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:43.635806 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-23d22d2b-cc45-4983-b2a6-d04844699bbf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.283554 Sep 01 16:34:43.636531 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 60/135] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:43 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:43.708677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d0ab2940-e2c5-449c-ae40-3722ffce7ec3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:43.717152 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d0ab2940-e2c5-449c-ae40-3722ffce7ec3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1362 microversion: 2.1 time: 0.157356 Sep 01 16:34:43.717735 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 76/136] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:43 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:44.372796 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d0f00a72-e295-4158-a353-55b155a3e15f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:44.373509 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d0f00a72-e295-4158-a353-55b155a3e15f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:44.379494 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d0f00a72-e295-4158-a353-55b155a3e15f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:44.379960 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d0f00a72-e295-4158-a353-55b155a3e15f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:44.380383 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d0f00a72-e295-4158-a353-55b155a3e15f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:44.388107 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d0f00a72-e295-4158-a353-55b155a3e15f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:44.388107 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d0f00a72-e295-4158-a353-55b155a3e15f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:44.388107 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d0f00a72-e295-4158-a353-55b155a3e15f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:44.497296 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1c743cc5-a327-4357-8bb4-4cc9781f0f92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:44.498514 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1c743cc5-a327-4357-8bb4-4cc9781f0f92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:44.504959 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c743cc5-a327-4357-8bb4-4cc9781f0f92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:44.505436 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c743cc5-a327-4357-8bb4-4cc9781f0f92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:44.505859 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c743cc5-a327-4357-8bb4-4cc9781f0f92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:44.506761 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c743cc5-a327-4357-8bb4-4cc9781f0f92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:44.507206 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c743cc5-a327-4357-8bb4-4cc9781f0f92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:44.507618 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c743cc5-a327-4357-8bb4-4cc9781f0f92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:44.525107 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d0f00a72-e295-4158-a353-55b155a3e15f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:44.533307 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d0f00a72-e295-4158-a353-55b155a3e15f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.164988 Sep 01 16:34:44.534050 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 61/137] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:44 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:44.645385 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1c743cc5-a327-4357-8bb4-4cc9781f0f92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:44.653758 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1c743cc5-a327-4357-8bb4-4cc9781f0f92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.160771 Sep 01 16:34:44.654860 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 77/138] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:44 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:44.658047 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7f9af780-1304-4156-8e95-09db630f58bb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:44.658707 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7f9af780-1304-4156-8e95-09db630f58bb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:44.665789 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7f9af780-1304-4156-8e95-09db630f58bb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:44.666289 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7f9af780-1304-4156-8e95-09db630f58bb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:44.667282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7f9af780-1304-4156-8e95-09db630f58bb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:44.668024 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7f9af780-1304-4156-8e95-09db630f58bb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:44.668383 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7f9af780-1304-4156-8e95-09db630f58bb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:44.668789 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7f9af780-1304-4156-8e95-09db630f58bb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:44.738847 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0d23f5c9-f87d-47b7-85d9-a4eff316e974 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:44.739446 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0d23f5c9-f87d-47b7-85d9-a4eff316e974 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:44.746141 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d23f5c9-f87d-47b7-85d9-a4eff316e974 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:44.746685 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d23f5c9-f87d-47b7-85d9-a4eff316e974 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:44.747112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d23f5c9-f87d-47b7-85d9-a4eff316e974 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:44.747790 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d23f5c9-f87d-47b7-85d9-a4eff316e974 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:44.748230 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d23f5c9-f87d-47b7-85d9-a4eff316e974 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:44.748643 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d23f5c9-f87d-47b7-85d9-a4eff316e974 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:44.810456 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-7f9af780-1304-4156-8e95-09db630f58bb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:44.820017 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-7f9af780-1304-4156-8e95-09db630f58bb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:44.821490 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-7f9af780-1304-4156-8e95-09db630f58bb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:44.822626 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7f9af780-1304-4156-8e95-09db630f58bb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.168485 Sep 01 16:34:44.834299 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 62/139] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:44 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:44.893723 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0d23f5c9-f87d-47b7-85d9-a4eff316e974 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:44.901396 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0d23f5c9-f87d-47b7-85d9-a4eff316e974 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1362 microversion: 2.1 time: 0.166730 Sep 01 16:34:44.901948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 78/140] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:44 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:45.559554 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-71c2d1d0-c437-4581-a64e-5b566b9a7164 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:45.560729 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-71c2d1d0-c437-4581-a64e-5b566b9a7164 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:45.573779 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-71c2d1d0-c437-4581-a64e-5b566b9a7164 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:45.575220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-71c2d1d0-c437-4581-a64e-5b566b9a7164 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:45.576450 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-71c2d1d0-c437-4581-a64e-5b566b9a7164 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:45.578788 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-71c2d1d0-c437-4581-a64e-5b566b9a7164 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:45.579491 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-71c2d1d0-c437-4581-a64e-5b566b9a7164 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:45.580308 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-71c2d1d0-c437-4581-a64e-5b566b9a7164 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:45.673794 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8185c6ec-e014-4b6e-b608-03fe3b84d0e7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:45.674422 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8185c6ec-e014-4b6e-b608-03fe3b84d0e7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:45.680677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8185c6ec-e014-4b6e-b608-03fe3b84d0e7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:45.681151 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8185c6ec-e014-4b6e-b608-03fe3b84d0e7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:45.681579 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8185c6ec-e014-4b6e-b608-03fe3b84d0e7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:45.682389 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8185c6ec-e014-4b6e-b608-03fe3b84d0e7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:45.682768 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8185c6ec-e014-4b6e-b608-03fe3b84d0e7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:45.683178 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8185c6ec-e014-4b6e-b608-03fe3b84d0e7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:45.950655 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8185c6ec-e014-4b6e-b608-03fe3b84d0e7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:45.966143 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8185c6ec-e014-4b6e-b608-03fe3b84d0e7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.296004 Sep 01 16:34:45.966733 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 79/141] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:45 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:45.971560 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b7ecd856-ff6b-4a85-898e-fda73f33e4cd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:45.972493 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b7ecd856-ff6b-4a85-898e-fda73f33e4cd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:45.978634 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7ecd856-ff6b-4a85-898e-fda73f33e4cd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:45.980102 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7ecd856-ff6b-4a85-898e-fda73f33e4cd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:45.980658 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7ecd856-ff6b-4a85-898e-fda73f33e4cd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:45.981516 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7ecd856-ff6b-4a85-898e-fda73f33e4cd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:45.982045 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7ecd856-ff6b-4a85-898e-fda73f33e4cd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:45.982505 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7ecd856-ff6b-4a85-898e-fda73f33e4cd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:46.018419 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-71c2d1d0-c437-4581-a64e-5b566b9a7164 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:46.027744 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-71c2d1d0-c437-4581-a64e-5b566b9a7164 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.476309 Sep 01 16:34:46.028499 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 63/142] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:45 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:46.035326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-72b32443-aa1c-4d2b-889e-529194651958 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:46.042911 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-72b32443-aa1c-4d2b-889e-529194651958 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:46.051206 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-72b32443-aa1c-4d2b-889e-529194651958 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:46.051695 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-72b32443-aa1c-4d2b-889e-529194651958 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:46.052125 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-72b32443-aa1c-4d2b-889e-529194651958 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:46.052827 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-72b32443-aa1c-4d2b-889e-529194651958 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:46.053278 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-72b32443-aa1c-4d2b-889e-529194651958 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:46.055137 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-72b32443-aa1c-4d2b-889e-529194651958 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:46.192181 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b7ecd856-ff6b-4a85-898e-fda73f33e4cd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:46.203525 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b7ecd856-ff6b-4a85-898e-fda73f33e4cd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:46.205011 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b7ecd856-ff6b-4a85-898e-fda73f33e4cd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:46.206998 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b7ecd856-ff6b-4a85-898e-fda73f33e4cd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.239009 Sep 01 16:34:46.214345 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 80/143] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:45 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:46.771504 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-72b32443-aa1c-4d2b-889e-529194651958 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:46.780982 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-72b32443-aa1c-4d2b-889e-529194651958 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1362 microversion: 2.1 time: 0.751101 Sep 01 16:34:46.787136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 64/144] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:46 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1362 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:46.870321 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-54475b6a-cbd9-4cd8-bbbe-0a2446a9c4b9 req-c3a80493-b458-43fa-8c25-9dde7f9d3872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fae886be-6615-48f8-8482-9f04376a3dd3", "tag": "1a82e99d-ba3e-4063-bdf7-4d47fa07f110"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:46.884243 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-54475b6a-cbd9-4cd8-bbbe-0a2446a9c4b9 req-c3a80493-b458-43fa-8c25-9dde7f9d3872 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:46.884736 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-54475b6a-cbd9-4cd8-bbbe-0a2446a9c4b9 req-c3a80493-b458-43fa-8c25-9dde7f9d3872 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:46.885891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-54475b6a-cbd9-4cd8-bbbe-0a2446a9c4b9 req-c3a80493-b458-43fa-8c25-9dde7f9d3872 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:46.907017 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-54475b6a-cbd9-4cd8-bbbe-0a2446a9c4b9 req-c3a80493-b458-43fa-8c25-9dde7f9d3872 service nova] Creating event network-changed:1a82e99d-ba3e-4063-bdf7-4d47fa07f110 for instance fae886be-6615-48f8-8482-9f04376a3dd3 on hv-cinder-85220 Sep 01 16:34:46.907533 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-54475b6a-cbd9-4cd8-bbbe-0a2446a9c4b9 req-c3a80493-b458-43fa-8c25-9dde7f9d3872 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127177) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 16:34:46.908115 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-54475b6a-cbd9-4cd8-bbbe-0a2446a9c4b9 req-c3a80493-b458-43fa-8c25-9dde7f9d3872 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127177) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 16:34:46.909315 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e7ed5e74-650f-401f-9591-a4f150671b9a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:46.909806 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e7ed5e74-650f-401f-9591-a4f150671b9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:46.910252 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e7ed5e74-650f-401f-9591-a4f150671b9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:46.910966 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e7ed5e74-650f-401f-9591-a4f150671b9a None None] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:46.911409 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e7ed5e74-650f-401f-9591-a4f150671b9a None None] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:46.912007 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e7ed5e74-650f-401f-9591-a4f150671b9a None None] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:46.921728 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.compute.rpcapi [None req-e7ed5e74-650f-401f-9591-a4f150671b9a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 16:34:46.922633 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e7ed5e74-650f-401f-9591-a4f150671b9a None None] Releasing lock "compute-rpcapi-router" {{(pid=127177) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 16:34:46.940721 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e7ed5e74-650f-401f-9591-a4f150671b9a None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075058 Sep 01 16:34:46.941339 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 81/145] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:46.988099 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d4bbad74-751e-4ab4-afe1-9e643460f42b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:46.988685 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d4bbad74-751e-4ab4-afe1-9e643460f42b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:46.996295 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4bbad74-751e-4ab4-afe1-9e643460f42b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:46.996771 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4bbad74-751e-4ab4-afe1-9e643460f42b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:46.997193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4bbad74-751e-4ab4-afe1-9e643460f42b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:46.997873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4bbad74-751e-4ab4-afe1-9e643460f42b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:46.998335 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4bbad74-751e-4ab4-afe1-9e643460f42b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:46.998744 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4bbad74-751e-4ab4-afe1-9e643460f42b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:47.062029 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3e18166b-17b6-4880-a11d-de41ba8fe7ba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:47.062847 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3e18166b-17b6-4880-a11d-de41ba8fe7ba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:47.078570 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e18166b-17b6-4880-a11d-de41ba8fe7ba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:47.079135 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e18166b-17b6-4880-a11d-de41ba8fe7ba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:47.079644 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e18166b-17b6-4880-a11d-de41ba8fe7ba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:47.080456 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e18166b-17b6-4880-a11d-de41ba8fe7ba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:47.080935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e18166b-17b6-4880-a11d-de41ba8fe7ba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:47.081381 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e18166b-17b6-4880-a11d-de41ba8fe7ba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:47.232586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3e18166b-17b6-4880-a11d-de41ba8fe7ba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:47.240495 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3e18166b-17b6-4880-a11d-de41ba8fe7ba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.189559 Sep 01 16:34:47.241077 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 82/146] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:47 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:47.246558 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e6c29e40-9af9-483b-8f7b-18c7eda85cf1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:47.247340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e6c29e40-9af9-483b-8f7b-18c7eda85cf1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:47.253649 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6c29e40-9af9-483b-8f7b-18c7eda85cf1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:47.254418 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6c29e40-9af9-483b-8f7b-18c7eda85cf1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:47.255229 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6c29e40-9af9-483b-8f7b-18c7eda85cf1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:47.256526 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6c29e40-9af9-483b-8f7b-18c7eda85cf1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:47.256526 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6c29e40-9af9-483b-8f7b-18c7eda85cf1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:47.256959 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6c29e40-9af9-483b-8f7b-18c7eda85cf1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:47.278421 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:47.392039 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d4bbad74-751e-4ab4-afe1-9e643460f42b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:47.414385 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d4bbad74-751e-4ab4-afe1-9e643460f42b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.427850 Sep 01 16:34:47.428082 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 65/147] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:46 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:47.457337 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e6c29e40-9af9-483b-8f7b-18c7eda85cf1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:47.465878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e6c29e40-9af9-483b-8f7b-18c7eda85cf1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:47.467526 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e6c29e40-9af9-483b-8f7b-18c7eda85cf1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:47.468660 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e6c29e40-9af9-483b-8f7b-18c7eda85cf1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.226407 Sep 01 16:34:47.469221 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 83/148] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:47 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:47.511349 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-a026bbde-330f-48db-9699-93457c871711 req-6cc82af1-3424-40df-bb2d-d8ebe4ae5ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13e447e7-8805-447e-8cf9-7771733bf00f", "name": "network-vif-plugged", "status": "completed", "tag": "871bccd9-3596-40d8-8c9a-f29d5ba58a45"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:47.523208 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-a026bbde-330f-48db-9699-93457c871711 req-6cc82af1-3424-40df-bb2d-d8ebe4ae5ded service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:47.523677 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-a026bbde-330f-48db-9699-93457c871711 req-6cc82af1-3424-40df-bb2d-d8ebe4ae5ded service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:47.524105 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-a026bbde-330f-48db-9699-93457c871711 req-6cc82af1-3424-40df-bb2d-d8ebe4ae5ded service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:47.539107 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-a026bbde-330f-48db-9699-93457c871711 req-6cc82af1-3424-40df-bb2d-d8ebe4ae5ded service nova] Creating event network-vif-plugged:871bccd9-3596-40d8-8c9a-f29d5ba58a45 for instance 13e447e7-8805-447e-8cf9-7771733bf00f on hv-cinder-85220 Sep 01 16:34:47.544467 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-a026bbde-330f-48db-9699-93457c871711 req-6cc82af1-3424-40df-bb2d-d8ebe4ae5ded service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114984 Sep 01 16:34:47.545792 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 66/149] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:47.803157 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-43073a08-c9b7-4621-91ed-1fc063fc1f7f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:47.803929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-43073a08-c9b7-4621-91ed-1fc063fc1f7f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:47.810996 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43073a08-c9b7-4621-91ed-1fc063fc1f7f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:47.811735 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43073a08-c9b7-4621-91ed-1fc063fc1f7f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:47.812368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43073a08-c9b7-4621-91ed-1fc063fc1f7f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:47.813287 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43073a08-c9b7-4621-91ed-1fc063fc1f7f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:47.813803 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43073a08-c9b7-4621-91ed-1fc063fc1f7f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:47.814504 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43073a08-c9b7-4621-91ed-1fc063fc1f7f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:47.981181 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-43073a08-c9b7-4621-91ed-1fc063fc1f7f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:47.989931 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-43073a08-c9b7-4621-91ed-1fc063fc1f7f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1362 microversion: 2.1 time: 0.190550 Sep 01 16:34:47.999269 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 84/150] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:47 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:48.261470 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-411d6d87-952b-43c0-a8d6-4703ef59fcdc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:48.262147 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-411d6d87-952b-43c0-a8d6-4703ef59fcdc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:48.268783 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-411d6d87-952b-43c0-a8d6-4703ef59fcdc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:48.269321 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-411d6d87-952b-43c0-a8d6-4703ef59fcdc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:48.269943 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-411d6d87-952b-43c0-a8d6-4703ef59fcdc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:48.270868 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-411d6d87-952b-43c0-a8d6-4703ef59fcdc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:48.271515 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-411d6d87-952b-43c0-a8d6-4703ef59fcdc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:48.272196 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-411d6d87-952b-43c0-a8d6-4703ef59fcdc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:48.438685 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7a6b5f9e-3912-40f9-b125-34af2bf053b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:48.439317 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7a6b5f9e-3912-40f9-b125-34af2bf053b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:48.453836 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-411d6d87-952b-43c0-a8d6-4703ef59fcdc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:48.458505 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a6b5f9e-3912-40f9-b125-34af2bf053b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:48.459004 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a6b5f9e-3912-40f9-b125-34af2bf053b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:48.459446 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a6b5f9e-3912-40f9-b125-34af2bf053b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:48.460274 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a6b5f9e-3912-40f9-b125-34af2bf053b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:48.460770 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a6b5f9e-3912-40f9-b125-34af2bf053b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:48.461213 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a6b5f9e-3912-40f9-b125-34af2bf053b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:48.467833 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-411d6d87-952b-43c0-a8d6-4703ef59fcdc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.208940 Sep 01 16:34:48.467833 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 67/151] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:48 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:48.493026 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-26c3b929-e071-4368-a946-a7f8d32ad7cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:48.493568 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-26c3b929-e071-4368-a946-a7f8d32ad7cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:48.499903 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-26c3b929-e071-4368-a946-a7f8d32ad7cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:48.500388 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-26c3b929-e071-4368-a946-a7f8d32ad7cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:48.500822 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-26c3b929-e071-4368-a946-a7f8d32ad7cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:48.501716 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-26c3b929-e071-4368-a946-a7f8d32ad7cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:48.502378 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-26c3b929-e071-4368-a946-a7f8d32ad7cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:48.502950 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-26c3b929-e071-4368-a946-a7f8d32ad7cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:48.649760 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7a6b5f9e-3912-40f9-b125-34af2bf053b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:48.660183 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7a6b5f9e-3912-40f9-b125-34af2bf053b3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.225250 Sep 01 16:34:48.661202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 85/152] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:48 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:48.675019 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-26c3b929-e071-4368-a946-a7f8d32ad7cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:48.687213 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-26c3b929-e071-4368-a946-a7f8d32ad7cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:48.689221 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-26c3b929-e071-4368-a946-a7f8d32ad7cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:48.690644 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-26c3b929-e071-4368-a946-a7f8d32ad7cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.202826 Sep 01 16:34:48.691427 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 68/153] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:48 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:48.958872 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-51dcd548-7737-4154-add3-93522c7c9205 req-a4a85060-19f5-4a9f-8245-dcad9b032f6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f220c0ef-c9c6-4fb0-995b-6daea95e841f", "tag": "38cd1838-9a61-4f72-a995-2bc777df4564"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:48.968101 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-51dcd548-7737-4154-add3-93522c7c9205 req-a4a85060-19f5-4a9f-8245-dcad9b032f6e service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:48.968561 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-51dcd548-7737-4154-add3-93522c7c9205 req-a4a85060-19f5-4a9f-8245-dcad9b032f6e service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:48.968972 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-51dcd548-7737-4154-add3-93522c7c9205 req-a4a85060-19f5-4a9f-8245-dcad9b032f6e service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:48.979952 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-51dcd548-7737-4154-add3-93522c7c9205 req-a4a85060-19f5-4a9f-8245-dcad9b032f6e service nova] Creating event network-changed:38cd1838-9a61-4f72-a995-2bc777df4564 for instance f220c0ef-c9c6-4fb0-995b-6daea95e841f on hv-cinder-85220 Sep 01 16:34:48.984816 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-51dcd548-7737-4154-add3-93522c7c9205 req-a4a85060-19f5-4a9f-8245-dcad9b032f6e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029518 Sep 01 16:34:48.985561 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 86/154] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:49.013212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-1b5f0d41-6af7-4fb4-a77b-f61bd9021930 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:49.013726 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-1b5f0d41-6af7-4fb4-a77b-f61bd9021930 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:49.019783 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b5f0d41-6af7-4fb4-a77b-f61bd9021930 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:49.020383 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b5f0d41-6af7-4fb4-a77b-f61bd9021930 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:49.020977 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b5f0d41-6af7-4fb4-a77b-f61bd9021930 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:49.021829 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b5f0d41-6af7-4fb4-a77b-f61bd9021930 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:49.022304 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b5f0d41-6af7-4fb4-a77b-f61bd9021930 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:49.022728 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b5f0d41-6af7-4fb4-a77b-f61bd9021930 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:49.214884 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-1b5f0d41-6af7-4fb4-a77b-f61bd9021930 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:49.224523 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-1b5f0d41-6af7-4fb4-a77b-f61bd9021930 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1362 microversion: 2.1 time: 0.216317 Sep 01 16:34:49.225363 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 69/155] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:49 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:49.488418 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-88f22a2c-88dd-4d37-95df-c6e8e269f8b4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:49.489115 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-88f22a2c-88dd-4d37-95df-c6e8e269f8b4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:49.506298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-88f22a2c-88dd-4d37-95df-c6e8e269f8b4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:49.506812 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-88f22a2c-88dd-4d37-95df-c6e8e269f8b4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:49.513509 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-88f22a2c-88dd-4d37-95df-c6e8e269f8b4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:49.514277 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-88f22a2c-88dd-4d37-95df-c6e8e269f8b4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:49.518286 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-88f22a2c-88dd-4d37-95df-c6e8e269f8b4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:49.518758 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-88f22a2c-88dd-4d37-95df-c6e8e269f8b4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:49.695757 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-127b6712-daaa-43f9-8835-c08bfe797c3c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:49.697807 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-127b6712-daaa-43f9-8835-c08bfe797c3c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:49.705056 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-127b6712-daaa-43f9-8835-c08bfe797c3c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:49.705800 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-127b6712-daaa-43f9-8835-c08bfe797c3c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:49.706781 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-127b6712-daaa-43f9-8835-c08bfe797c3c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:49.707667 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-127b6712-daaa-43f9-8835-c08bfe797c3c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:49.708519 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-127b6712-daaa-43f9-8835-c08bfe797c3c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:49.708946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-127b6712-daaa-43f9-8835-c08bfe797c3c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:49.709818 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-88f22a2c-88dd-4d37-95df-c6e8e269f8b4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:49.719350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-88f22a2c-88dd-4d37-95df-c6e8e269f8b4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.235581 Sep 01 16:34:49.719928 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 87/156] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:49 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:49.737058 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-99c480ee-331e-4ba4-b55e-1a96f3b24054 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:49.738137 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-99c480ee-331e-4ba4-b55e-1a96f3b24054 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:49.746249 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99c480ee-331e-4ba4-b55e-1a96f3b24054 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:49.747686 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99c480ee-331e-4ba4-b55e-1a96f3b24054 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:49.748558 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99c480ee-331e-4ba4-b55e-1a96f3b24054 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:49.749904 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99c480ee-331e-4ba4-b55e-1a96f3b24054 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:49.751738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99c480ee-331e-4ba4-b55e-1a96f3b24054 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:49.752309 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99c480ee-331e-4ba4-b55e-1a96f3b24054 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:49.984292 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-99c480ee-331e-4ba4-b55e-1a96f3b24054 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:49.994573 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-99c480ee-331e-4ba4-b55e-1a96f3b24054 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:49.998695 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-99c480ee-331e-4ba4-b55e-1a96f3b24054 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:50.000863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-99c480ee-331e-4ba4-b55e-1a96f3b24054 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.273699 Sep 01 16:34:50.001577 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 88/157] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:49 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:50.247102 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a9eb590c-c8ef-4b1f-831f-b29f78014036 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:50.247723 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a9eb590c-c8ef-4b1f-831f-b29f78014036 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:50.263899 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-127b6712-daaa-43f9-8835-c08bfe797c3c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:50.267891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9eb590c-c8ef-4b1f-831f-b29f78014036 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:50.271467 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9eb590c-c8ef-4b1f-831f-b29f78014036 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:50.272126 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9eb590c-c8ef-4b1f-831f-b29f78014036 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:50.273205 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9eb590c-c8ef-4b1f-831f-b29f78014036 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:50.273718 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9eb590c-c8ef-4b1f-831f-b29f78014036 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:50.274144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-127b6712-daaa-43f9-8835-c08bfe797c3c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.582296 Sep 01 16:34:50.274303 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9eb590c-c8ef-4b1f-831f-b29f78014036 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:50.275227 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 70/158] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:49 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:50.643770 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a9eb590c-c8ef-4b1f-831f-b29f78014036 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:50.659221 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a9eb590c-c8ef-4b1f-831f-b29f78014036 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1362 microversion: 2.1 time: 0.416348 Sep 01 16:34:50.671664 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 89/159] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:50 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1362 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:50.742476 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-30e48bf2-225e-4766-9d35-f3afac0cefc0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:50.745441 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-30e48bf2-225e-4766-9d35-f3afac0cefc0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:50.755077 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-30e48bf2-225e-4766-9d35-f3afac0cefc0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:50.755778 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-30e48bf2-225e-4766-9d35-f3afac0cefc0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:50.756829 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-30e48bf2-225e-4766-9d35-f3afac0cefc0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:50.758582 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-30e48bf2-225e-4766-9d35-f3afac0cefc0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:50.759370 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-30e48bf2-225e-4766-9d35-f3afac0cefc0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:50.760086 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-30e48bf2-225e-4766-9d35-f3afac0cefc0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:50.999476 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-30e48bf2-225e-4766-9d35-f3afac0cefc0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:51.011957 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-30e48bf2-225e-4766-9d35-f3afac0cefc0 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.274495 Sep 01 16:34:51.014100 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 71/160] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:50 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:51.032248 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7a8826bb-b61f-477a-afbf-7a4867844998 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:51.032767 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7a8826bb-b61f-477a-afbf-7a4867844998 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:51.040653 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a8826bb-b61f-477a-afbf-7a4867844998 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:51.041144 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a8826bb-b61f-477a-afbf-7a4867844998 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:51.042093 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a8826bb-b61f-477a-afbf-7a4867844998 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:51.042855 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a8826bb-b61f-477a-afbf-7a4867844998 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:51.043312 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a8826bb-b61f-477a-afbf-7a4867844998 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:51.043741 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a8826bb-b61f-477a-afbf-7a4867844998 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:51.250563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7a8826bb-b61f-477a-afbf-7a4867844998 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:51.263997 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7a8826bb-b61f-477a-afbf-7a4867844998 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:51.272206 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7a8826bb-b61f-477a-afbf-7a4867844998 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:51.274468 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7a8826bb-b61f-477a-afbf-7a4867844998 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.245193 Sep 01 16:34:51.289886 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 90/161] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:51 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:51.297316 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7040c6c1-a4d5-455d-9bdf-662b2fd9c422 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:51.297909 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7040c6c1-a4d5-455d-9bdf-662b2fd9c422 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:51.311366 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7040c6c1-a4d5-455d-9bdf-662b2fd9c422 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:51.312399 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7040c6c1-a4d5-455d-9bdf-662b2fd9c422 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:51.313370 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7040c6c1-a4d5-455d-9bdf-662b2fd9c422 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:51.314625 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7040c6c1-a4d5-455d-9bdf-662b2fd9c422 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:51.315432 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7040c6c1-a4d5-455d-9bdf-662b2fd9c422 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:51.316121 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7040c6c1-a4d5-455d-9bdf-662b2fd9c422 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:51.519925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-7040c6c1-a4d5-455d-9bdf-662b2fd9c422 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:51.527582 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7040c6c1-a4d5-455d-9bdf-662b2fd9c422 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.235695 Sep 01 16:34:51.528158 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 72/162] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:51 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:51.684373 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ac0b1fac-d049-42bb-a378-2a9bd00d4718 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:51.685064 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ac0b1fac-d049-42bb-a378-2a9bd00d4718 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:51.696760 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac0b1fac-d049-42bb-a378-2a9bd00d4718 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:51.697319 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac0b1fac-d049-42bb-a378-2a9bd00d4718 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:51.698713 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac0b1fac-d049-42bb-a378-2a9bd00d4718 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:51.701174 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac0b1fac-d049-42bb-a378-2a9bd00d4718 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:51.702919 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac0b1fac-d049-42bb-a378-2a9bd00d4718 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:51.703935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac0b1fac-d049-42bb-a378-2a9bd00d4718 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:51.889535 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ac0b1fac-d049-42bb-a378-2a9bd00d4718 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:51.903872 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ac0b1fac-d049-42bb-a378-2a9bd00d4718 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1362 microversion: 2.1 time: 0.225458 Sep 01 16:34:51.917206 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 91/163] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:51 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:52.034397 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-9983cd4d-55df-4a34-aa16-cf5374b4cf40 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:52.034994 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-9983cd4d-55df-4a34-aa16-cf5374b4cf40 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:52.049224 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9983cd4d-55df-4a34-aa16-cf5374b4cf40 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:52.049707 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9983cd4d-55df-4a34-aa16-cf5374b4cf40 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:52.050132 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9983cd4d-55df-4a34-aa16-cf5374b4cf40 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.050900 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9983cd4d-55df-4a34-aa16-cf5374b4cf40 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:52.051465 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9983cd4d-55df-4a34-aa16-cf5374b4cf40 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:52.051732 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9983cd4d-55df-4a34-aa16-cf5374b4cf40 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.065008 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-421ccabe-6998-4789-afc3-ec23dcca1d6e req-9e15fb4d-a4ae-42a4-9465-fb4957ef2f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0958ba3f-7f1d-4fa1-bff7-4459d3945b6f", "name": "network-vif-plugged", "status": "completed", "tag": "46daf8ff-8552-45e4-b4ac-b60b47e199de"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:52.092470 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-421ccabe-6998-4789-afc3-ec23dcca1d6e req-9e15fb4d-a4ae-42a4-9465-fb4957ef2f8f service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:52.092948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-421ccabe-6998-4789-afc3-ec23dcca1d6e req-9e15fb4d-a4ae-42a4-9465-fb4957ef2f8f service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:52.093364 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-421ccabe-6998-4789-afc3-ec23dcca1d6e req-9e15fb4d-a4ae-42a4-9465-fb4957ef2f8f service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.132616 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-421ccabe-6998-4789-afc3-ec23dcca1d6e req-9e15fb4d-a4ae-42a4-9465-fb4957ef2f8f service nova] Creating event network-vif-plugged:46daf8ff-8552-45e4-b4ac-b60b47e199de for instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f on hv-cinder-85220 Sep 01 16:34:52.143983 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-421ccabe-6998-4789-afc3-ec23dcca1d6e req-9e15fb4d-a4ae-42a4-9465-fb4957ef2f8f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082559 Sep 01 16:34:52.148723 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 92/164] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:34:52.299818 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c6f70bc7-1332-4337-9b21-9d4f5a9db3fc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:52.300922 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c6f70bc7-1332-4337-9b21-9d4f5a9db3fc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:52.315633 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6f70bc7-1332-4337-9b21-9d4f5a9db3fc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:52.322985 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6f70bc7-1332-4337-9b21-9d4f5a9db3fc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:52.322985 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6f70bc7-1332-4337-9b21-9d4f5a9db3fc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.323434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6f70bc7-1332-4337-9b21-9d4f5a9db3fc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:52.323887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6f70bc7-1332-4337-9b21-9d4f5a9db3fc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:52.328275 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6f70bc7-1332-4337-9b21-9d4f5a9db3fc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.771810 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c6f70bc7-1332-4337-9b21-9d4f5a9db3fc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:52.790763 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c6f70bc7-1332-4337-9b21-9d4f5a9db3fc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:52.797067 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c6f70bc7-1332-4337-9b21-9d4f5a9db3fc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:52.802045 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c6f70bc7-1332-4337-9b21-9d4f5a9db3fc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.506473 Sep 01 16:34:52.810158 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 93/165] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:52 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:52.815106 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-970dea8c-ae02-496c-82ea-b27f629e2712 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:52.830375 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-970dea8c-ae02-496c-82ea-b27f629e2712 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:52.851071 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-970dea8c-ae02-496c-82ea-b27f629e2712 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:52.857749 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-970dea8c-ae02-496c-82ea-b27f629e2712 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:52.860284 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-970dea8c-ae02-496c-82ea-b27f629e2712 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.861424 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-970dea8c-ae02-496c-82ea-b27f629e2712 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:52.862332 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-970dea8c-ae02-496c-82ea-b27f629e2712 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:52.863507 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-970dea8c-ae02-496c-82ea-b27f629e2712 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.951256 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9983cd4d-55df-4a34-aa16-cf5374b4cf40 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:52.981737 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-9983cd4d-55df-4a34-aa16-cf5374b4cf40 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.944791 Sep 01 16:34:52.983724 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 73/166] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:52 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:52.989596 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b943c531-da9a-4426-90e6-735ffc94af7a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:52.990190 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b943c531-da9a-4426-90e6-735ffc94af7a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:53.006166 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b943c531-da9a-4426-90e6-735ffc94af7a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:53.006898 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b943c531-da9a-4426-90e6-735ffc94af7a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:53.007495 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b943c531-da9a-4426-90e6-735ffc94af7a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:53.008419 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b943c531-da9a-4426-90e6-735ffc94af7a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:53.009047 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b943c531-da9a-4426-90e6-735ffc94af7a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:53.009457 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b943c531-da9a-4426-90e6-735ffc94af7a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:53.227366 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b943c531-da9a-4426-90e6-735ffc94af7a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:53.232723 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-970dea8c-ae02-496c-82ea-b27f629e2712 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:53.238099 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b943c531-da9a-4426-90e6-735ffc94af7a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1362 microversion: 2.1 time: 0.253198 Sep 01 16:34:53.240450 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-970dea8c-ae02-496c-82ea-b27f629e2712 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.429015 Sep 01 16:34:53.241177 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 94/167] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:52 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:53.250488 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 74/168] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:52 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:53.847768 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-cbfc5ede-a394-4ce3-a61f-b6c79605c578 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:53.848543 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-cbfc5ede-a394-4ce3-a61f-b6c79605c578 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:53.856450 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cbfc5ede-a394-4ce3-a61f-b6c79605c578 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:53.856998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cbfc5ede-a394-4ce3-a61f-b6c79605c578 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:53.857437 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cbfc5ede-a394-4ce3-a61f-b6c79605c578 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:53.858198 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cbfc5ede-a394-4ce3-a61f-b6c79605c578 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:53.858730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cbfc5ede-a394-4ce3-a61f-b6c79605c578 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:53.859152 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cbfc5ede-a394-4ce3-a61f-b6c79605c578 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:54.003500 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-aa60d3d2-27e6-44c8-a4a4-926619632d70 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:54.003646 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-cbfc5ede-a394-4ce3-a61f-b6c79605c578 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:54.008144 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-aa60d3d2-27e6-44c8-a4a4-926619632d70 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:54.014478 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-cbfc5ede-a394-4ce3-a61f-b6c79605c578 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:54.017409 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-cbfc5ede-a394-4ce3-a61f-b6c79605c578 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:54.020404 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa60d3d2-27e6-44c8-a4a4-926619632d70 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:54.020641 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-cbfc5ede-a394-4ce3-a61f-b6c79605c578 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.177043 Sep 01 16:34:54.022844 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa60d3d2-27e6-44c8-a4a4-926619632d70 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:54.027445 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa60d3d2-27e6-44c8-a4a4-926619632d70 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:54.028176 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa60d3d2-27e6-44c8-a4a4-926619632d70 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:54.028673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa60d3d2-27e6-44c8-a4a4-926619632d70 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:54.029283 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa60d3d2-27e6-44c8-a4a4-926619632d70 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:54.033404 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 75/169] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:53 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:54.179339 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-aa60d3d2-27e6-44c8-a4a4-926619632d70 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:54.189264 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-aa60d3d2-27e6-44c8-a4a4-926619632d70 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.189457 Sep 01 16:34:54.190970 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 95/170] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:53 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:54.200416 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-86554aa0-c663-4ed4-b7f9-21c7dadb8dcc req-a82ea030-780a-4d10-b46c-aa3b20b05396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af33e17-eea1-4429-bca2-299dc3f02bf8", "name": "network-vif-plugged", "status": "completed", "tag": "b086b899-9326-4795-b2fc-0c23a4a38451"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:54.210991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-86554aa0-c663-4ed4-b7f9-21c7dadb8dcc req-a82ea030-780a-4d10-b46c-aa3b20b05396 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:54.211634 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-86554aa0-c663-4ed4-b7f9-21c7dadb8dcc req-a82ea030-780a-4d10-b46c-aa3b20b05396 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:54.212200 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-86554aa0-c663-4ed4-b7f9-21c7dadb8dcc req-a82ea030-780a-4d10-b46c-aa3b20b05396 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:54.218575 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=100 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:54.237662 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-86554aa0-c663-4ed4-b7f9-21c7dadb8dcc req-a82ea030-780a-4d10-b46c-aa3b20b05396 service nova] Creating event network-vif-plugged:b086b899-9326-4795-b2fc-0c23a4a38451 for instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 on hv-cinder-85220 Sep 01 16:34:54.247653 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-86554aa0-c663-4ed4-b7f9-21c7dadb8dcc req-a82ea030-780a-4d10-b46c-aa3b20b05396 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051403 Sep 01 16:34:54.248261 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 76/171] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:54.261600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-61b26815-b7b9-493c-a65f-c273619a5b97 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:54.262269 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-61b26815-b7b9-493c-a65f-c273619a5b97 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:54.265151 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-8a6cafe3-bd48-428f-a50a-062b4d263cd2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:54.265844 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-8a6cafe3-bd48-428f-a50a-062b4d263cd2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:54.273229 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61b26815-b7b9-493c-a65f-c273619a5b97 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:54.276889 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61b26815-b7b9-493c-a65f-c273619a5b97 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:54.277664 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61b26815-b7b9-493c-a65f-c273619a5b97 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:54.280594 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61b26815-b7b9-493c-a65f-c273619a5b97 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:54.281081 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61b26815-b7b9-493c-a65f-c273619a5b97 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:54.281512 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61b26815-b7b9-493c-a65f-c273619a5b97 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:54.282685 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8a6cafe3-bd48-428f-a50a-062b4d263cd2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:54.283162 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8a6cafe3-bd48-428f-a50a-062b4d263cd2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:54.283822 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8a6cafe3-bd48-428f-a50a-062b4d263cd2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:54.284763 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8a6cafe3-bd48-428f-a50a-062b4d263cd2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:54.285546 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8a6cafe3-bd48-428f-a50a-062b4d263cd2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:54.288513 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8a6cafe3-bd48-428f-a50a-062b4d263cd2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:54.448978 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-8a6cafe3-bd48-428f-a50a-062b4d263cd2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:54.457895 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-8a6cafe3-bd48-428f-a50a-062b4d263cd2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.200140 Sep 01 16:34:54.472380 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-61b26815-b7b9-493c-a65f-c273619a5b97 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:54.478386 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 77/172] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:54 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:54.484802 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-61b26815-b7b9-493c-a65f-c273619a5b97 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1362 microversion: 2.1 time: 0.228878 Sep 01 16:34:54.485367 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 96/173] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:54 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:55.047008 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d3cc3998-962c-4273-90b4-fc27fa80918e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:55.047626 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d3cc3998-962c-4273-90b4-fc27fa80918e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:55.054010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3cc3998-962c-4273-90b4-fc27fa80918e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:55.054959 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3cc3998-962c-4273-90b4-fc27fa80918e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:55.055394 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3cc3998-962c-4273-90b4-fc27fa80918e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:55.056278 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3cc3998-962c-4273-90b4-fc27fa80918e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:55.057525 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3cc3998-962c-4273-90b4-fc27fa80918e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:55.058153 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3cc3998-962c-4273-90b4-fc27fa80918e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:55.208808 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d3cc3998-962c-4273-90b4-fc27fa80918e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:55.211482 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e1c0f8ca-1404-432a-901e-3bf393dbeb54 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:55.212229 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e1c0f8ca-1404-432a-901e-3bf393dbeb54 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:55.217434 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d3cc3998-962c-4273-90b4-fc27fa80918e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:55.219113 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d3cc3998-962c-4273-90b4-fc27fa80918e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:55.219454 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e1c0f8ca-1404-432a-901e-3bf393dbeb54 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:55.219932 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e1c0f8ca-1404-432a-901e-3bf393dbeb54 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:55.220431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e1c0f8ca-1404-432a-901e-3bf393dbeb54 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:55.221237 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d3cc3998-962c-4273-90b4-fc27fa80918e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.180918 Sep 01 16:34:55.221366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e1c0f8ca-1404-432a-901e-3bf393dbeb54 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:55.221761 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e1c0f8ca-1404-432a-901e-3bf393dbeb54 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:55.222412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e1c0f8ca-1404-432a-901e-3bf393dbeb54 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:55.237865 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 78/174] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:55 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:55.381339 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e1c0f8ca-1404-432a-901e-3bf393dbeb54 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:55.389094 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e1c0f8ca-1404-432a-901e-3bf393dbeb54 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.181793 Sep 01 16:34:55.389663 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 97/175] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:55 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:55.479980 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e8308c71-39ed-452c-94fa-97d5a48ff9a8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:55.480579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-e8308c71-39ed-452c-94fa-97d5a48ff9a8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:55.486516 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8308c71-39ed-452c-94fa-97d5a48ff9a8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:55.487241 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8308c71-39ed-452c-94fa-97d5a48ff9a8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:55.487659 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8308c71-39ed-452c-94fa-97d5a48ff9a8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:55.488532 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8308c71-39ed-452c-94fa-97d5a48ff9a8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:55.489137 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8308c71-39ed-452c-94fa-97d5a48ff9a8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:55.489561 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8308c71-39ed-452c-94fa-97d5a48ff9a8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:55.510111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-21f0d6b8-1213-4290-a9a5-212a8872a765 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:55.510111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-21f0d6b8-1213-4290-a9a5-212a8872a765 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:55.514887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21f0d6b8-1213-4290-a9a5-212a8872a765 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:55.515364 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21f0d6b8-1213-4290-a9a5-212a8872a765 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:55.516418 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21f0d6b8-1213-4290-a9a5-212a8872a765 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:55.518008 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21f0d6b8-1213-4290-a9a5-212a8872a765 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:55.518750 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21f0d6b8-1213-4290-a9a5-212a8872a765 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:55.519392 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21f0d6b8-1213-4290-a9a5-212a8872a765 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:55.641970 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e8308c71-39ed-452c-94fa-97d5a48ff9a8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:55.650378 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-e8308c71-39ed-452c-94fa-97d5a48ff9a8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.175282 Sep 01 16:34:55.668860 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 79/176] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:55 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:55.688964 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-21f0d6b8-1213-4290-a9a5-212a8872a765 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:55.697144 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-21f0d6b8-1213-4290-a9a5-212a8872a765 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1362 microversion: 2.1 time: 0.195148 Sep 01 16:34:55.712749 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 98/177] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:55 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:56.245168 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-09d077ab-8814-4cab-955c-04654201ab30 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:56.245730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-09d077ab-8814-4cab-955c-04654201ab30 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:56.251971 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09d077ab-8814-4cab-955c-04654201ab30 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:56.252836 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09d077ab-8814-4cab-955c-04654201ab30 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:56.253208 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09d077ab-8814-4cab-955c-04654201ab30 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:56.253813 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09d077ab-8814-4cab-955c-04654201ab30 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:56.254268 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09d077ab-8814-4cab-955c-04654201ab30 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:56.254688 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09d077ab-8814-4cab-955c-04654201ab30 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:56.395707 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-759c5bc7-0fb9-4d58-b88e-b8f1ae2cdf4c req-5f31b702-861e-449c-af6a-85a71a576f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f220c0ef-c9c6-4fb0-995b-6daea95e841f", "name": "network-vif-plugged", "status": "completed", "tag": "38cd1838-9a61-4f72-a995-2bc777df4564"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:56.411957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-759c5bc7-0fb9-4d58-b88e-b8f1ae2cdf4c req-5f31b702-861e-449c-af6a-85a71a576f09 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:56.412704 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-759c5bc7-0fb9-4d58-b88e-b8f1ae2cdf4c req-5f31b702-861e-449c-af6a-85a71a576f09 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:56.413877 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-759c5bc7-0fb9-4d58-b88e-b8f1ae2cdf4c req-5f31b702-861e-449c-af6a-85a71a576f09 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:56.433318 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-759c5bc7-0fb9-4d58-b88e-b8f1ae2cdf4c req-5f31b702-861e-449c-af6a-85a71a576f09 service nova] Creating event network-vif-plugged:38cd1838-9a61-4f72-a995-2bc777df4564 for instance f220c0ef-c9c6-4fb0-995b-6daea95e841f on hv-cinder-85220 Sep 01 16:34:56.438009 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-09d077ab-8814-4cab-955c-04654201ab30 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:56.451756 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-09d077ab-8814-4cab-955c-04654201ab30 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:56.459283 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-759c5bc7-0fb9-4d58-b88e-b8f1ae2cdf4c req-5f31b702-861e-449c-af6a-85a71a576f09 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066575 Sep 01 16:34:56.460069 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 99/178] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:56.464029 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-09d077ab-8814-4cab-955c-04654201ab30 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:56.466095 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-09d077ab-8814-4cab-955c-04654201ab30 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.225007 Sep 01 16:34:56.467280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 80/179] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:56 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:56.469123 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d5b8abe4-1d36-40b9-8581-063d028872d3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:56.471676 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d5b8abe4-1d36-40b9-8581-063d028872d3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:56.475006 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:56.480255 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d5b8abe4-1d36-40b9-8581-063d028872d3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:56.480946 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d5b8abe4-1d36-40b9-8581-063d028872d3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:56.481670 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d5b8abe4-1d36-40b9-8581-063d028872d3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:56.482864 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d5b8abe4-1d36-40b9-8581-063d028872d3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:56.483468 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d5b8abe4-1d36-40b9-8581-063d028872d3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:56.484073 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d5b8abe4-1d36-40b9-8581-063d028872d3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:56.674481 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b002363d-5b07-4495-ad89-77b21a1cfbf8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:56.675146 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b002363d-5b07-4495-ad89-77b21a1cfbf8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:56.684997 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b002363d-5b07-4495-ad89-77b21a1cfbf8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:56.686161 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b002363d-5b07-4495-ad89-77b21a1cfbf8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:56.686908 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b002363d-5b07-4495-ad89-77b21a1cfbf8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:56.688038 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b002363d-5b07-4495-ad89-77b21a1cfbf8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:56.688554 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b002363d-5b07-4495-ad89-77b21a1cfbf8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:56.689042 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b002363d-5b07-4495-ad89-77b21a1cfbf8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:56.710172 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d5b8abe4-1d36-40b9-8581-063d028872d3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:56.718983 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d5b8abe4-1d36-40b9-8581-063d028872d3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.254971 Sep 01 16:34:56.722374 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 100/180] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:56 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:56.730733 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1084abe6-e844-4eb1-a40e-410d1bdef6fa tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:56.737012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1084abe6-e844-4eb1-a40e-410d1bdef6fa tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:56.751340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1084abe6-e844-4eb1-a40e-410d1bdef6fa tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:56.751831 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1084abe6-e844-4eb1-a40e-410d1bdef6fa tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:56.752253 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1084abe6-e844-4eb1-a40e-410d1bdef6fa tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:56.753416 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1084abe6-e844-4eb1-a40e-410d1bdef6fa tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:56.754203 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1084abe6-e844-4eb1-a40e-410d1bdef6fa tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:56.755028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1084abe6-e844-4eb1-a40e-410d1bdef6fa tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:56.871752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b002363d-5b07-4495-ad89-77b21a1cfbf8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:56.879504 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b002363d-5b07-4495-ad89-77b21a1cfbf8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.209502 Sep 01 16:34:56.880382 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 81/181] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:56 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:56.919667 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:56.981694 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1084abe6-e844-4eb1-a40e-410d1bdef6fa tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:56.990023 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1084abe6-e844-4eb1-a40e-410d1bdef6fa tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1362 microversion: 2.1 time: 0.263277 Sep 01 16:34:56.990781 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 101/182] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:56 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:57.491399 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-68b83ef6-25ef-4f6d-8d49-5f7621dafe2f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:57.492002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-68b83ef6-25ef-4f6d-8d49-5f7621dafe2f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:57.497879 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-68b83ef6-25ef-4f6d-8d49-5f7621dafe2f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:57.498390 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-68b83ef6-25ef-4f6d-8d49-5f7621dafe2f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:57.498822 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-68b83ef6-25ef-4f6d-8d49-5f7621dafe2f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:57.499501 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-68b83ef6-25ef-4f6d-8d49-5f7621dafe2f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:57.500066 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-68b83ef6-25ef-4f6d-8d49-5f7621dafe2f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:57.500488 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-68b83ef6-25ef-4f6d-8d49-5f7621dafe2f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:57.637323 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-68b83ef6-25ef-4f6d-8d49-5f7621dafe2f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:57.645619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-68b83ef6-25ef-4f6d-8d49-5f7621dafe2f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:57.647172 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-68b83ef6-25ef-4f6d-8d49-5f7621dafe2f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:57.648266 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-68b83ef6-25ef-4f6d-8d49-5f7621dafe2f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.160779 Sep 01 16:34:57.648812 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 82/183] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:57 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:57.740077 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f735a1a2-f8e8-4106-ba9c-7f4d09d46124 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:57.740679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f735a1a2-f8e8-4106-ba9c-7f4d09d46124 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:57.746647 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f735a1a2-f8e8-4106-ba9c-7f4d09d46124 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:57.747123 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f735a1a2-f8e8-4106-ba9c-7f4d09d46124 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:57.747634 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f735a1a2-f8e8-4106-ba9c-7f4d09d46124 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:57.748231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f735a1a2-f8e8-4106-ba9c-7f4d09d46124 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:57.748671 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f735a1a2-f8e8-4106-ba9c-7f4d09d46124 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:57.749080 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f735a1a2-f8e8-4106-ba9c-7f4d09d46124 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:57.753089 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:57.882994 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f735a1a2-f8e8-4106-ba9c-7f4d09d46124 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:57.891862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f735a1a2-f8e8-4106-ba9c-7f4d09d46124 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.155500 Sep 01 16:34:57.892518 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 102/184] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:57 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:57.900435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d1ebc246-e1d2-44cb-8d2e-6d576837d6ce tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:57.901035 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d1ebc246-e1d2-44cb-8d2e-6d576837d6ce tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:57.907454 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d1ebc246-e1d2-44cb-8d2e-6d576837d6ce tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:57.908226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d1ebc246-e1d2-44cb-8d2e-6d576837d6ce tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:57.908718 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d1ebc246-e1d2-44cb-8d2e-6d576837d6ce tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:57.909788 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d1ebc246-e1d2-44cb-8d2e-6d576837d6ce tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:57.910443 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d1ebc246-e1d2-44cb-8d2e-6d576837d6ce tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:57.911345 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d1ebc246-e1d2-44cb-8d2e-6d576837d6ce tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:58.012199 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-078716b8-8487-4738-a310-52469822f486 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:58.012891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-078716b8-8487-4738-a310-52469822f486 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:58.018924 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-078716b8-8487-4738-a310-52469822f486 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:58.019467 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-078716b8-8487-4738-a310-52469822f486 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:58.020086 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-078716b8-8487-4738-a310-52469822f486 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:58.020973 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-078716b8-8487-4738-a310-52469822f486 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:58.021597 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-078716b8-8487-4738-a310-52469822f486 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:58.022013 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-078716b8-8487-4738-a310-52469822f486 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:58.051636 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d1ebc246-e1d2-44cb-8d2e-6d576837d6ce tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:58.060315 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d1ebc246-e1d2-44cb-8d2e-6d576837d6ce tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.163666 Sep 01 16:34:58.061546 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 83/185] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:57 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:58.159824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-078716b8-8487-4738-a310-52469822f486 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:58.168534 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-078716b8-8487-4738-a310-52469822f486 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1362 microversion: 2.1 time: 0.160887 Sep 01 16:34:58.169443 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 103/186] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:58 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:58.677551 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b68ddde0-13df-4f91-8606-aae21dfa3b86 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:58.679162 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b68ddde0-13df-4f91-8606-aae21dfa3b86 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:58.694258 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b68ddde0-13df-4f91-8606-aae21dfa3b86 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:58.694739 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b68ddde0-13df-4f91-8606-aae21dfa3b86 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:58.695265 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b68ddde0-13df-4f91-8606-aae21dfa3b86 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:58.696735 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b68ddde0-13df-4f91-8606-aae21dfa3b86 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:58.696841 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b68ddde0-13df-4f91-8606-aae21dfa3b86 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:58.698464 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b68ddde0-13df-4f91-8606-aae21dfa3b86 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:58.836318 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b68ddde0-13df-4f91-8606-aae21dfa3b86 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:58.845326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b68ddde0-13df-4f91-8606-aae21dfa3b86 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:58.846741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b68ddde0-13df-4f91-8606-aae21dfa3b86 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:58.847842 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b68ddde0-13df-4f91-8606-aae21dfa3b86 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.178693 Sep 01 16:34:58.848411 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 84/187] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:58 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:58.913795 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-49780894-225b-4e15-897e-c67e4a371209 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:58.914485 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-49780894-225b-4e15-897e-c67e4a371209 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:58.921690 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49780894-225b-4e15-897e-c67e4a371209 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:58.922671 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49780894-225b-4e15-897e-c67e4a371209 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:58.923105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49780894-225b-4e15-897e-c67e4a371209 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:58.924145 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49780894-225b-4e15-897e-c67e4a371209 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:58.924598 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49780894-225b-4e15-897e-c67e4a371209 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:58.925038 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49780894-225b-4e15-897e-c67e4a371209 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:59.065358 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-49780894-225b-4e15-897e-c67e4a371209 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:59.073051 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-49780894-225b-4e15-897e-c67e4a371209 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.163100 Sep 01 16:34:59.073614 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 104/188] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:58 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:59.082431 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-76c8ea13-cda4-4f69-a062-2a05c4db5448 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:59.083102 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-76c8ea13-cda4-4f69-a062-2a05c4db5448 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:59.089364 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-76c8ea13-cda4-4f69-a062-2a05c4db5448 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:59.089840 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-76c8ea13-cda4-4f69-a062-2a05c4db5448 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:59.090290 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-76c8ea13-cda4-4f69-a062-2a05c4db5448 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:59.090975 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-76c8ea13-cda4-4f69-a062-2a05c4db5448 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:59.091416 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-76c8ea13-cda4-4f69-a062-2a05c4db5448 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:59.091830 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-76c8ea13-cda4-4f69-a062-2a05c4db5448 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:59.192068 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3514798a-1410-4481-b69d-957cbf66fbd2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:59.193157 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3514798a-1410-4481-b69d-957cbf66fbd2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:59.199661 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3514798a-1410-4481-b69d-957cbf66fbd2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:59.200138 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3514798a-1410-4481-b69d-957cbf66fbd2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:59.200758 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3514798a-1410-4481-b69d-957cbf66fbd2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:59.201446 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3514798a-1410-4481-b69d-957cbf66fbd2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:59.202340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3514798a-1410-4481-b69d-957cbf66fbd2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:59.202761 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3514798a-1410-4481-b69d-957cbf66fbd2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:59.224639 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-76c8ea13-cda4-4f69-a062-2a05c4db5448 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:59.233111 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-76c8ea13-cda4-4f69-a062-2a05c4db5448 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.154847 Sep 01 16:34:59.233687 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 85/189] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:59 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:59.333446 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3514798a-1410-4481-b69d-957cbf66fbd2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:59.342969 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3514798a-1410-4481-b69d-957cbf66fbd2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1362 microversion: 2.1 time: 0.156110 Sep 01 16:34:59.343651 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 105/190] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:59 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:59.870370 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-dc1f9aa5-984f-4847-be96-b68f79310e9b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:59.870961 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-dc1f9aa5-984f-4847-be96-b68f79310e9b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:59.876901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dc1f9aa5-984f-4847-be96-b68f79310e9b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:59.877386 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dc1f9aa5-984f-4847-be96-b68f79310e9b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:59.877809 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dc1f9aa5-984f-4847-be96-b68f79310e9b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:59.878521 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dc1f9aa5-984f-4847-be96-b68f79310e9b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:59.878953 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dc1f9aa5-984f-4847-be96-b68f79310e9b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:59.879361 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dc1f9aa5-984f-4847-be96-b68f79310e9b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:00.020722 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-dc1f9aa5-984f-4847-be96-b68f79310e9b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:00.030003 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-dc1f9aa5-984f-4847-be96-b68f79310e9b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:00.031558 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-dc1f9aa5-984f-4847-be96-b68f79310e9b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:00.032662 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-dc1f9aa5-984f-4847-be96-b68f79310e9b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1407 microversion: 2.20 time: 0.166320 Sep 01 16:35:00.033287 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 86/191] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:59 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:00.101473 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ae0606bf-9aad-4eb3-9e2e-fc4d324e4c90 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:00.102263 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ae0606bf-9aad-4eb3-9e2e-fc4d324e4c90 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:00.109407 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ae0606bf-9aad-4eb3-9e2e-fc4d324e4c90 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:00.109911 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ae0606bf-9aad-4eb3-9e2e-fc4d324e4c90 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:00.110366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ae0606bf-9aad-4eb3-9e2e-fc4d324e4c90 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:00.111053 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ae0606bf-9aad-4eb3-9e2e-fc4d324e4c90 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:00.111502 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ae0606bf-9aad-4eb3-9e2e-fc4d324e4c90 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:00.111921 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ae0606bf-9aad-4eb3-9e2e-fc4d324e4c90 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:00.260979 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b4a91739-2d51-43f7-9743-ce049ead88ae tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:00.264533 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b4a91739-2d51-43f7-9743-ce049ead88ae tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:00.270895 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ae0606bf-9aad-4eb3-9e2e-fc4d324e4c90 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:00.282069 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b4a91739-2d51-43f7-9743-ce049ead88ae tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:00.282510 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b4a91739-2d51-43f7-9743-ce049ead88ae tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:00.282944 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b4a91739-2d51-43f7-9743-ce049ead88ae tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:00.283653 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b4a91739-2d51-43f7-9743-ce049ead88ae tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:00.290326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b4a91739-2d51-43f7-9743-ce049ead88ae tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:00.290326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b4a91739-2d51-43f7-9743-ce049ead88ae tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:00.290668 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ae0606bf-9aad-4eb3-9e2e-fc4d324e4c90 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.195513 Sep 01 16:35:00.290668 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 106/192] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:00 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:00.383547 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-406f7c52-d1de-4ee9-b310-6da0a969ef26 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:00.384483 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-406f7c52-d1de-4ee9-b310-6da0a969ef26 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:00.393939 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-406f7c52-d1de-4ee9-b310-6da0a969ef26 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:00.394527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-406f7c52-d1de-4ee9-b310-6da0a969ef26 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:00.395034 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-406f7c52-d1de-4ee9-b310-6da0a969ef26 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:00.395929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-406f7c52-d1de-4ee9-b310-6da0a969ef26 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:00.396412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-406f7c52-d1de-4ee9-b310-6da0a969ef26 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:00.396872 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-406f7c52-d1de-4ee9-b310-6da0a969ef26 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:00.458995 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b4a91739-2d51-43f7-9743-ce049ead88ae tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:00.468275 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b4a91739-2d51-43f7-9743-ce049ead88ae tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.217791 Sep 01 16:35:00.468812 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 87/193] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:00 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:00.626679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-406f7c52-d1de-4ee9-b310-6da0a969ef26 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:00.635602 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-406f7c52-d1de-4ee9-b310-6da0a969ef26 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1362 microversion: 2.1 time: 0.260100 Sep 01 16:35:00.636274 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 107/194] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:00 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:01.055669 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-39f14f42-2825-4c8c-ad74-73242ab22698 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:01.056442 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-39f14f42-2825-4c8c-ad74-73242ab22698 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:01.062960 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-39f14f42-2825-4c8c-ad74-73242ab22698 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:01.063474 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-39f14f42-2825-4c8c-ad74-73242ab22698 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:01.063862 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-39f14f42-2825-4c8c-ad74-73242ab22698 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:01.064547 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-39f14f42-2825-4c8c-ad74-73242ab22698 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:01.064997 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-39f14f42-2825-4c8c-ad74-73242ab22698 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:01.065413 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-39f14f42-2825-4c8c-ad74-73242ab22698 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:01.197025 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-39f14f42-2825-4c8c-ad74-73242ab22698 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:01.205946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-39f14f42-2825-4c8c-ad74-73242ab22698 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:01.207452 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-39f14f42-2825-4c8c-ad74-73242ab22698 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:01.208631 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-39f14f42-2825-4c8c-ad74-73242ab22698 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1598 microversion: 2.20 time: 0.156661 Sep 01 16:35:01.209202 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 88/195] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:01 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:01.232620 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bb977738-68b9-407e-bc2c-7dfb8f441b15 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:01.233163 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bb977738-68b9-407e-bc2c-7dfb8f441b15 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:01.239480 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb977738-68b9-407e-bc2c-7dfb8f441b15 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:01.240048 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb977738-68b9-407e-bc2c-7dfb8f441b15 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:01.240478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb977738-68b9-407e-bc2c-7dfb8f441b15 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:01.241162 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb977738-68b9-407e-bc2c-7dfb8f441b15 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:01.241679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb977738-68b9-407e-bc2c-7dfb8f441b15 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:01.242099 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb977738-68b9-407e-bc2c-7dfb8f441b15 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:01.310665 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c47a3cbc-8d8a-492b-83d6-e0aff36efcbc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:01.311829 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c47a3cbc-8d8a-492b-83d6-e0aff36efcbc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:01.320421 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c47a3cbc-8d8a-492b-83d6-e0aff36efcbc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:01.320910 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c47a3cbc-8d8a-492b-83d6-e0aff36efcbc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:01.321342 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c47a3cbc-8d8a-492b-83d6-e0aff36efcbc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:01.322997 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c47a3cbc-8d8a-492b-83d6-e0aff36efcbc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:01.323882 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c47a3cbc-8d8a-492b-83d6-e0aff36efcbc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:01.324308 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c47a3cbc-8d8a-492b-83d6-e0aff36efcbc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:01.377356 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bb977738-68b9-407e-bc2c-7dfb8f441b15 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.148890 Sep 01 16:35:01.378060 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 108/196] 10.222.0.18 () {60 vars in 1316 bytes} [Thu Sep 1 16:35:01 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:35:01.491834 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b74310ae-1b62-4e76-b3c3-ab1d6b18f3b1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:01.491834 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b74310ae-1b62-4e76-b3c3-ab1d6b18f3b1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:01.504050 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b74310ae-1b62-4e76-b3c3-ab1d6b18f3b1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:01.504546 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b74310ae-1b62-4e76-b3c3-ab1d6b18f3b1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:01.504985 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b74310ae-1b62-4e76-b3c3-ab1d6b18f3b1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:01.505729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b74310ae-1b62-4e76-b3c3-ab1d6b18f3b1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:01.510342 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b74310ae-1b62-4e76-b3c3-ab1d6b18f3b1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:01.513390 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b74310ae-1b62-4e76-b3c3-ab1d6b18f3b1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:01.515133 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c47a3cbc-8d8a-492b-83d6-e0aff36efcbc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:01.524007 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c47a3cbc-8d8a-492b-83d6-e0aff36efcbc tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.219881 Sep 01 16:35:01.527490 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 89/197] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:01 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:01.660592 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-30ea907c-811f-4280-9a34-26c81394a39d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:01.661062 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-30ea907c-811f-4280-9a34-26c81394a39d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:01.679172 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-30ea907c-811f-4280-9a34-26c81394a39d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:01.681312 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-30ea907c-811f-4280-9a34-26c81394a39d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:01.683847 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-30ea907c-811f-4280-9a34-26c81394a39d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:01.683847 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-30ea907c-811f-4280-9a34-26c81394a39d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:01.683847 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-30ea907c-811f-4280-9a34-26c81394a39d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:01.688897 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-30ea907c-811f-4280-9a34-26c81394a39d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:01.823869 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b74310ae-1b62-4e76-b3c3-ab1d6b18f3b1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:01.834178 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b74310ae-1b62-4e76-b3c3-ab1d6b18f3b1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.348958 Sep 01 16:35:01.835511 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 109/198] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:01 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:01.911993 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-30ea907c-811f-4280-9a34-26c81394a39d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:01.921197 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-30ea907c-811f-4280-9a34-26c81394a39d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1362 microversion: 2.1 time: 0.267549 Sep 01 16:35:01.935677 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 90/199] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:01 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:02.549563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-01464878-8142-4dc5-8e75-61cb713d9783 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:02.550274 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-01464878-8142-4dc5-8e75-61cb713d9783 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:02.560866 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01464878-8142-4dc5-8e75-61cb713d9783 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:02.561478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01464878-8142-4dc5-8e75-61cb713d9783 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:02.562003 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01464878-8142-4dc5-8e75-61cb713d9783 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:02.562943 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01464878-8142-4dc5-8e75-61cb713d9783 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:02.563517 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01464878-8142-4dc5-8e75-61cb713d9783 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:02.564120 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01464878-8142-4dc5-8e75-61cb713d9783 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:02.801987 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-01464878-8142-4dc5-8e75-61cb713d9783 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:02.810021 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-01464878-8142-4dc5-8e75-61cb713d9783 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.266218 Sep 01 16:35:02.810687 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 110/200] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:02 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:02.858002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ad3e03a8-3184-4257-bf41-dd4f18e6d7ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:02.859326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ad3e03a8-3184-4257-bf41-dd4f18e6d7ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:02.865234 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad3e03a8-3184-4257-bf41-dd4f18e6d7ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:02.866132 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad3e03a8-3184-4257-bf41-dd4f18e6d7ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:02.866604 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad3e03a8-3184-4257-bf41-dd4f18e6d7ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:02.867288 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad3e03a8-3184-4257-bf41-dd4f18e6d7ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:02.867733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad3e03a8-3184-4257-bf41-dd4f18e6d7ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:02.868144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad3e03a8-3184-4257-bf41-dd4f18e6d7ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:02.946668 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-00970be6-9b3f-4fd5-bb08-36688ddc827e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:02.948133 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-00970be6-9b3f-4fd5-bb08-36688ddc827e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:02.961600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00970be6-9b3f-4fd5-bb08-36688ddc827e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:02.962357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00970be6-9b3f-4fd5-bb08-36688ddc827e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:02.963436 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00970be6-9b3f-4fd5-bb08-36688ddc827e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:02.964276 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00970be6-9b3f-4fd5-bb08-36688ddc827e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:02.964809 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00970be6-9b3f-4fd5-bb08-36688ddc827e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:02.965438 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00970be6-9b3f-4fd5-bb08-36688ddc827e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:03.038535 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ad3e03a8-3184-4257-bf41-dd4f18e6d7ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:03.047065 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ad3e03a8-3184-4257-bf41-dd4f18e6d7ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.194816 Sep 01 16:35:03.047645 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 91/201] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:02 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:03.066873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-ac663b02-8f46-43c8-a9e0-063a0aae5552 req-c37041b8-f25b-487f-8bdd-88a2a53a932a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0958ba3f-7f1d-4fa1-bff7-4459d3945b6f", "tag": "46daf8ff-8552-45e4-b4ac-b60b47e199de"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:03.100076 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-ac663b02-8f46-43c8-a9e0-063a0aae5552 req-c37041b8-f25b-487f-8bdd-88a2a53a932a service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:03.100789 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-ac663b02-8f46-43c8-a9e0-063a0aae5552 req-c37041b8-f25b-487f-8bdd-88a2a53a932a service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:03.101775 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-ac663b02-8f46-43c8-a9e0-063a0aae5552 req-c37041b8-f25b-487f-8bdd-88a2a53a932a service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:03.115129 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-ac663b02-8f46-43c8-a9e0-063a0aae5552 req-c37041b8-f25b-487f-8bdd-88a2a53a932a service nova] Creating event network-changed:46daf8ff-8552-45e4-b4ac-b60b47e199de for instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f on hv-cinder-85220 Sep 01 16:35:03.123030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-ac663b02-8f46-43c8-a9e0-063a0aae5552 req-c37041b8-f25b-487f-8bdd-88a2a53a932a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067185 Sep 01 16:35:03.124064 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 92/202] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:35:03.162319 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-00970be6-9b3f-4fd5-bb08-36688ddc827e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:03.170587 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-00970be6-9b3f-4fd5-bb08-36688ddc827e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1362 microversion: 2.1 time: 0.229814 Sep 01 16:35:03.171478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 111/203] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:02 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:03.741500 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-63e6d38d-50e8-4ffb-acd9-dcfc70eb1237 req-4f03e614-942d-4274-9910-51dfa2be8ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fae886be-6615-48f8-8482-9f04376a3dd3", "name": "network-vif-plugged", "status": "completed", "tag": "1a82e99d-ba3e-4063-bdf7-4d47fa07f110"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:03.758191 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-63e6d38d-50e8-4ffb-acd9-dcfc70eb1237 req-4f03e614-942d-4274-9910-51dfa2be8ee2 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:03.759167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-63e6d38d-50e8-4ffb-acd9-dcfc70eb1237 req-4f03e614-942d-4274-9910-51dfa2be8ee2 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:03.759722 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-63e6d38d-50e8-4ffb-acd9-dcfc70eb1237 req-4f03e614-942d-4274-9910-51dfa2be8ee2 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:03.774783 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-63e6d38d-50e8-4ffb-acd9-dcfc70eb1237 req-4f03e614-942d-4274-9910-51dfa2be8ee2 service nova] Creating event network-vif-plugged:1a82e99d-ba3e-4063-bdf7-4d47fa07f110 for instance fae886be-6615-48f8-8482-9f04376a3dd3 on hv-cinder-85220 Sep 01 16:35:03.779965 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-63e6d38d-50e8-4ffb-acd9-dcfc70eb1237 req-4f03e614-942d-4274-9910-51dfa2be8ee2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044143 Sep 01 16:35:03.781181 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 93/204] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:35:03.831963 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a8036f9b-b6b4-490e-af23-1ec74461515f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:03.832708 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a8036f9b-b6b4-490e-af23-1ec74461515f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:03.854908 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a8036f9b-b6b4-490e-af23-1ec74461515f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:03.855569 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a8036f9b-b6b4-490e-af23-1ec74461515f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:03.856007 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a8036f9b-b6b4-490e-af23-1ec74461515f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:03.856712 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a8036f9b-b6b4-490e-af23-1ec74461515f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:03.857334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a8036f9b-b6b4-490e-af23-1ec74461515f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:03.866761 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a8036f9b-b6b4-490e-af23-1ec74461515f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:04.030301 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a8036f9b-b6b4-490e-af23-1ec74461515f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:04.039823 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a8036f9b-b6b4-490e-af23-1ec74461515f tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1314 microversion: 2.1 time: 0.211347 Sep 01 16:35:04.040563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 112/205] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:03 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:04.069391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-bedf458f-73a0-4170-bc9f-a11a2034126d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:04.070075 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-bedf458f-73a0-4170-bc9f-a11a2034126d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:04.086795 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bedf458f-73a0-4170-bc9f-a11a2034126d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:04.087297 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bedf458f-73a0-4170-bc9f-a11a2034126d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:04.090199 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bedf458f-73a0-4170-bc9f-a11a2034126d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:04.091001 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bedf458f-73a0-4170-bc9f-a11a2034126d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:04.092807 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bedf458f-73a0-4170-bc9f-a11a2034126d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:04.093899 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bedf458f-73a0-4170-bc9f-a11a2034126d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:04.192241 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bc01ed21-504f-4554-957a-3ee9865c3fa1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:04.193173 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bc01ed21-504f-4554-957a-3ee9865c3fa1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:04.201433 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc01ed21-504f-4554-957a-3ee9865c3fa1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:04.203770 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc01ed21-504f-4554-957a-3ee9865c3fa1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:04.205323 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc01ed21-504f-4554-957a-3ee9865c3fa1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:04.206177 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc01ed21-504f-4554-957a-3ee9865c3fa1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:04.209640 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc01ed21-504f-4554-957a-3ee9865c3fa1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:04.210074 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc01ed21-504f-4554-957a-3ee9865c3fa1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:04.434078 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-bedf458f-73a0-4170-bc9f-a11a2034126d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:04.438570 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bc01ed21-504f-4554-957a-3ee9865c3fa1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:04.441538 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=100 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:04.447380 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-bedf458f-73a0-4170-bc9f-a11a2034126d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.382674 Sep 01 16:35:04.448659 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 94/206] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:04 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:04.452253 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bc01ed21-504f-4554-957a-3ee9865c3fa1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1362 microversion: 2.1 time: 0.262835 Sep 01 16:35:04.452827 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 113/207] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:04 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:05.062386 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-5cbbc009-4cb4-4a23-ae6f-5ac2978b07c1 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:05.063209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-5cbbc009-4cb4-4a23-ae6f-5ac2978b07c1 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:05.065439 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=100 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:05.080905 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5cbbc009-4cb4-4a23-ae6f-5ac2978b07c1 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:05.081441 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5cbbc009-4cb4-4a23-ae6f-5ac2978b07c1 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:05.081911 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5cbbc009-4cb4-4a23-ae6f-5ac2978b07c1 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:05.082872 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5cbbc009-4cb4-4a23-ae6f-5ac2978b07c1 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:05.083444 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5cbbc009-4cb4-4a23-ae6f-5ac2978b07c1 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:05.084117 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5cbbc009-4cb4-4a23-ae6f-5ac2978b07c1 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:05.319377 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-5cbbc009-4cb4-4a23-ae6f-5ac2978b07c1 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:05.330851 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-5cbbc009-4cb4-4a23-ae6f-5ac2978b07c1 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1501 microversion: 2.1 time: 0.273269 Sep 01 16:35:05.332242 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 95/208] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:05 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1501 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:05.471364 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e6aaff72-8b47-40ee-91b1-e5c56b7cae1e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:05.472605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e6aaff72-8b47-40ee-91b1-e5c56b7cae1e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:05.488502 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-65282df0-b6d0-4871-a20f-545e1a803ac1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:05.491741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-65282df0-b6d0-4871-a20f-545e1a803ac1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:05.520144 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6aaff72-8b47-40ee-91b1-e5c56b7cae1e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:05.520651 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6aaff72-8b47-40ee-91b1-e5c56b7cae1e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:05.521635 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-65282df0-b6d0-4871-a20f-545e1a803ac1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:05.525889 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6aaff72-8b47-40ee-91b1-e5c56b7cae1e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:05.526391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-65282df0-b6d0-4871-a20f-545e1a803ac1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:05.527987 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6aaff72-8b47-40ee-91b1-e5c56b7cae1e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:05.528598 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-65282df0-b6d0-4871-a20f-545e1a803ac1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:05.530368 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-65282df0-b6d0-4871-a20f-545e1a803ac1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:05.531019 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6aaff72-8b47-40ee-91b1-e5c56b7cae1e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:05.537095 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-65282df0-b6d0-4871-a20f-545e1a803ac1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:05.537827 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6aaff72-8b47-40ee-91b1-e5c56b7cae1e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:05.541523 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-65282df0-b6d0-4871-a20f-545e1a803ac1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:05.833707 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e6aaff72-8b47-40ee-91b1-e5c56b7cae1e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:05.849007 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e6aaff72-8b47-40ee-91b1-e5c56b7cae1e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.381497 Sep 01 16:35:05.879326 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 114/209] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:05 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:05.992050 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-65282df0-b6d0-4871-a20f-545e1a803ac1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:06.000701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-65282df0-b6d0-4871-a20f-545e1a803ac1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1548 microversion: 2.1 time: 0.525354 Sep 01 16:35:06.026632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c424d360-c39d-4e28-881d-f5e8cb79e386 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:06.027128 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c424d360-c39d-4e28-881d-f5e8cb79e386 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:06.033692 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c424d360-c39d-4e28-881d-f5e8cb79e386 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:06.034203 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c424d360-c39d-4e28-881d-f5e8cb79e386 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:06.034368 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 96/210] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:05 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1548 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:06.042915 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c424d360-c39d-4e28-881d-f5e8cb79e386 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:06.043668 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c424d360-c39d-4e28-881d-f5e8cb79e386 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:06.044658 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c424d360-c39d-4e28-881d-f5e8cb79e386 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:06.045235 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c424d360-c39d-4e28-881d-f5e8cb79e386 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:06.193083 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c424d360-c39d-4e28-881d-f5e8cb79e386 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170678 Sep 01 16:35:06.194164 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 115/211] 10.222.0.18 () {58 vars in 1275 bytes} [Thu Sep 1 16:35:06 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:35:06.885800 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c58a2165-4c4f-4b3a-a5a7-2b5684d04058 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:06.887878 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c58a2165-4c4f-4b3a-a5a7-2b5684d04058 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:06.896330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c58a2165-4c4f-4b3a-a5a7-2b5684d04058 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:06.897157 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c58a2165-4c4f-4b3a-a5a7-2b5684d04058 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:06.898230 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c58a2165-4c4f-4b3a-a5a7-2b5684d04058 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:06.900002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c58a2165-4c4f-4b3a-a5a7-2b5684d04058 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:06.900829 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c58a2165-4c4f-4b3a-a5a7-2b5684d04058 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:06.902040 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c58a2165-4c4f-4b3a-a5a7-2b5684d04058 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:07.116472 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c58a2165-4c4f-4b3a-a5a7-2b5684d04058 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:07.129842 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c58a2165-4c4f-4b3a-a5a7-2b5684d04058 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.251218 Sep 01 16:35:07.155472 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b6bbb56d-cee2-461c-b3d6-d1ccd03134d5 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45b37b5d-089b-483f-ad76-4279d03b0559"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:07.156917 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 97/212] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:06 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:07.158943 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b6bbb56d-cee2-461c-b3d6-d1ccd03134d5 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:07.171960 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6bbb56d-cee2-461c-b3d6-d1ccd03134d5 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:07.175726 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6bbb56d-cee2-461c-b3d6-d1ccd03134d5 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:07.176333 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6bbb56d-cee2-461c-b3d6-d1ccd03134d5 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:07.177090 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6bbb56d-cee2-461c-b3d6-d1ccd03134d5 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:07.177499 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6bbb56d-cee2-461c-b3d6-d1ccd03134d5 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:07.177921 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6bbb56d-cee2-461c-b3d6-d1ccd03134d5 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:07.863689 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-2908c0ad-19a4-4b14-9af9-960819a85de2 req-19ac781c-f43b-42a1-8879-bac30ac55c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f220c0ef-c9c6-4fb0-995b-6daea95e841f", "tag": "38cd1838-9a61-4f72-a995-2bc777df4564"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:07.864345 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b6bbb56d-cee2-461c-b3d6-d1ccd03134d5 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "POST /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.707521 Sep 01 16:35:07.865208 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 116/213] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 1 16:35:07 2022] POST /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8/os-volume_attachments => generated 194 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:35:07.889449 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-2908c0ad-19a4-4b14-9af9-960819a85de2 req-19ac781c-f43b-42a1-8879-bac30ac55c80 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:07.889970 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-2908c0ad-19a4-4b14-9af9-960819a85de2 req-19ac781c-f43b-42a1-8879-bac30ac55c80 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:07.890967 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-2908c0ad-19a4-4b14-9af9-960819a85de2 req-19ac781c-f43b-42a1-8879-bac30ac55c80 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:07.905116 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-2908c0ad-19a4-4b14-9af9-960819a85de2 req-19ac781c-f43b-42a1-8879-bac30ac55c80 service nova] Creating event network-changed:38cd1838-9a61-4f72-a995-2bc777df4564 for instance f220c0ef-c9c6-4fb0-995b-6daea95e841f on hv-cinder-85220 Sep 01 16:35:07.911844 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-2908c0ad-19a4-4b14-9af9-960819a85de2 req-19ac781c-f43b-42a1-8879-bac30ac55c80 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053722 Sep 01 16:35:07.912783 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 98/214] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:35:08.182372 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6f4dd83a-e96f-4eda-825b-5052b3aa7017 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:08.183732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6f4dd83a-e96f-4eda-825b-5052b3aa7017 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:08.193096 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f4dd83a-e96f-4eda-825b-5052b3aa7017 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:08.193860 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f4dd83a-e96f-4eda-825b-5052b3aa7017 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:08.194825 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f4dd83a-e96f-4eda-825b-5052b3aa7017 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:08.197002 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f4dd83a-e96f-4eda-825b-5052b3aa7017 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:08.198898 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f4dd83a-e96f-4eda-825b-5052b3aa7017 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:08.199971 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f4dd83a-e96f-4eda-825b-5052b3aa7017 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:08.475226 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6f4dd83a-e96f-4eda-825b-5052b3aa7017 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:08.489467 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6f4dd83a-e96f-4eda-825b-5052b3aa7017 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1322 microversion: 2.1 time: 0.315892 Sep 01 16:35:08.490876 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 117/215] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:08 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:09.513901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e2f53bde-01b2-4c0c-a054-1e3a2f1cbca1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:09.514719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-e2f53bde-01b2-4c0c-a054-1e3a2f1cbca1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:09.525360 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e2f53bde-01b2-4c0c-a054-1e3a2f1cbca1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:09.526227 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e2f53bde-01b2-4c0c-a054-1e3a2f1cbca1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:09.526790 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e2f53bde-01b2-4c0c-a054-1e3a2f1cbca1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:09.527678 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e2f53bde-01b2-4c0c-a054-1e3a2f1cbca1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:09.528359 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e2f53bde-01b2-4c0c-a054-1e3a2f1cbca1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:09.529178 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e2f53bde-01b2-4c0c-a054-1e3a2f1cbca1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:09.711868 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e2f53bde-01b2-4c0c-a054-1e3a2f1cbca1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:09.722289 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-e2f53bde-01b2-4c0c-a054-1e3a2f1cbca1 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1514 microversion: 2.1 time: 0.213388 Sep 01 16:35:09.722999 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 99/216] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:09 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1514 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:09.745580 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-41635892-89c5-4a39-a1b5-b9d3b236bc23 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:09.748687 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-41635892-89c5-4a39-a1b5-b9d3b236bc23 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:09.762963 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41635892-89c5-4a39-a1b5-b9d3b236bc23 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:09.763840 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41635892-89c5-4a39-a1b5-b9d3b236bc23 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:09.764244 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41635892-89c5-4a39-a1b5-b9d3b236bc23 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:09.765165 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41635892-89c5-4a39-a1b5-b9d3b236bc23 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:09.765885 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41635892-89c5-4a39-a1b5-b9d3b236bc23 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:09.766606 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41635892-89c5-4a39-a1b5-b9d3b236bc23 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:09.771024 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:09.807248 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-41635892-89c5-4a39-a1b5-b9d3b236bc23 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lazy-loading 'flavor' on Instance uuid fae886be-6615-48f8-8482-9f04376a3dd3 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:35:09.992684 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-41635892-89c5-4a39-a1b5-b9d3b236bc23 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "POST /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3/action" status: 200 len: 32 microversion: 2.1 time: 0.252615 Sep 01 16:35:09.993303 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 118/217] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 1 16:35:09 2022] POST /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:35:10.003209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a3820f3b-9bfc-4798-a59e-031c9651ebdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:10.004019 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a3820f3b-9bfc-4798-a59e-031c9651ebdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:10.013382 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a3820f3b-9bfc-4798-a59e-031c9651ebdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:10.016034 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a3820f3b-9bfc-4798-a59e-031c9651ebdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:10.016897 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a3820f3b-9bfc-4798-a59e-031c9651ebdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:10.018512 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a3820f3b-9bfc-4798-a59e-031c9651ebdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:10.020144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a3820f3b-9bfc-4798-a59e-031c9651ebdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:10.020758 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a3820f3b-9bfc-4798-a59e-031c9651ebdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:10.258428 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a3820f3b-9bfc-4798-a59e-031c9651ebdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:10.267305 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a3820f3b-9bfc-4798-a59e-031c9651ebdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.267965 Sep 01 16:35:10.275470 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 100/218] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:09 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:11.291102 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5b0df89a-974a-4e91-9f93-f781bab1f4ff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:11.293425 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5b0df89a-974a-4e91-9f93-f781bab1f4ff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:11.301135 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b0df89a-974a-4e91-9f93-f781bab1f4ff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:11.301873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b0df89a-974a-4e91-9f93-f781bab1f4ff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:11.302535 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b0df89a-974a-4e91-9f93-f781bab1f4ff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:11.303621 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b0df89a-974a-4e91-9f93-f781bab1f4ff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:11.304386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b0df89a-974a-4e91-9f93-f781bab1f4ff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:11.304950 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b0df89a-974a-4e91-9f93-f781bab1f4ff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:11.588975 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5b0df89a-974a-4e91-9f93-f781bab1f4ff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:11.590348 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5b0df89a-974a-4e91-9f93-f781bab1f4ff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.304173 Sep 01 16:35:11.602888 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 119/219] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:11 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:12.612926 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f4a79618-1048-4d7d-a271-f487dcdeb52f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:12.614203 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f4a79618-1048-4d7d-a271-f487dcdeb52f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:12.621676 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f4a79618-1048-4d7d-a271-f487dcdeb52f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:12.622001 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f4a79618-1048-4d7d-a271-f487dcdeb52f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:12.622442 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f4a79618-1048-4d7d-a271-f487dcdeb52f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:12.623208 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f4a79618-1048-4d7d-a271-f487dcdeb52f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:12.623849 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f4a79618-1048-4d7d-a271-f487dcdeb52f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:12.624438 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f4a79618-1048-4d7d-a271-f487dcdeb52f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:12.809093 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f4a79618-1048-4d7d-a271-f487dcdeb52f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:12.819610 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f4a79618-1048-4d7d-a271-f487dcdeb52f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.210469 Sep 01 16:35:12.820753 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 101/220] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:12 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:13.479412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2033005052", "imageRef": "46185d58-0d47-4c97-b590-0f4434aa5c9e", "flavorRef": "452", "networks": [{"uuid": "d5d66e81-f1e9-4144-8569-14dac1ce6e4e"}]}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:13.544781 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] validate_networks() for [('d5d66e81-f1e9-4144-8569-14dac1ce6e4e', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:35:13.848378 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c9ed3aa1-c197-469f-b2c5-5dfa2936ecf6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:13.849005 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c9ed3aa1-c197-469f-b2c5-5dfa2936ecf6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:13.858632 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c9ed3aa1-c197-469f-b2c5-5dfa2936ecf6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:13.859132 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c9ed3aa1-c197-469f-b2c5-5dfa2936ecf6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:13.859559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c9ed3aa1-c197-469f-b2c5-5dfa2936ecf6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:13.860258 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c9ed3aa1-c197-469f-b2c5-5dfa2936ecf6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:13.860958 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c9ed3aa1-c197-469f-b2c5-5dfa2936ecf6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:13.861405 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c9ed3aa1-c197-469f-b2c5-5dfa2936ecf6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:14.055018 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c9ed3aa1-c197-469f-b2c5-5dfa2936ecf6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:14.065073 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:35:14.065623 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:35:14.066167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:35:14.066660 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:35:14.067339 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:35:14.082452 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c9ed3aa1-c197-469f-b2c5-5dfa2936ecf6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.242259 Sep 01 16:35:14.083347 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 102/221] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:13 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:14.085726 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:14.086258 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:14.086693 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:14.087995 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:14.088448 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:14.088882 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:14.107145 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Getting quotas for project 0939af057f4940298089c8f89ec2865f. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:35:14.111749 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Getting quotas for user 7425d9aefcf940709f3a3aad4166755c and project 0939af057f4940298089c8f89ec2865f. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:35:14.124172 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:35:14.126522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46185d58-0d47-4c97-b590-0f4434aa5c9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:35:14.177229 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0f5e3ffc-edeb-4140-9138-849cd7866d68 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703451 Sep 01 16:35:14.178125 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 120/222] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:35:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:35:14.189430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-0b96a3ef-45a8-401a-8775-551be8f6db5a tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:14.190293 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0b96a3ef-45a8-401a-8775-551be8f6db5a tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:14.264442 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0b96a3ef-45a8-401a-8775-551be8f6db5a tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:14.273183 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-0b96a3ef-45a8-401a-8775-551be8f6db5a tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 200 len: 1214 microversion: 2.1 time: 0.087512 Sep 01 16:35:14.287397 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 103/223] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:14 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:15.106312 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0e721579-d783-4db8-a5d6-d2d4e8ce766a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:15.106918 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0e721579-d783-4db8-a5d6-d2d4e8ce766a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:15.113294 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0e721579-d783-4db8-a5d6-d2d4e8ce766a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:15.113772 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0e721579-d783-4db8-a5d6-d2d4e8ce766a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:15.114275 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0e721579-d783-4db8-a5d6-d2d4e8ce766a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:15.114953 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0e721579-d783-4db8-a5d6-d2d4e8ce766a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:15.115409 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0e721579-d783-4db8-a5d6-d2d4e8ce766a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:15.115815 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0e721579-d783-4db8-a5d6-d2d4e8ce766a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:15.246394 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0e721579-d783-4db8-a5d6-d2d4e8ce766a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:15.254299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0e721579-d783-4db8-a5d6-d2d4e8ce766a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.153342 Sep 01 16:35:15.255046 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 121/224] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:15 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:15.296245 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-5a516eca-cc18-4a91-93a0-a5ffa3a845e3 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:15.296897 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-5a516eca-cc18-4a91-93a0-a5ffa3a845e3 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:15.302761 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5a516eca-cc18-4a91-93a0-a5ffa3a845e3 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:15.303225 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5a516eca-cc18-4a91-93a0-a5ffa3a845e3 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:15.303662 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5a516eca-cc18-4a91-93a0-a5ffa3a845e3 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:15.304330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5a516eca-cc18-4a91-93a0-a5ffa3a845e3 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:15.304823 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5a516eca-cc18-4a91-93a0-a5ffa3a845e3 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:15.305413 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5a516eca-cc18-4a91-93a0-a5ffa3a845e3 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:15.369112 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-5a516eca-cc18-4a91-93a0-a5ffa3a845e3 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:15.376786 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-5a516eca-cc18-4a91-93a0-a5ffa3a845e3 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 200 len: 1266 microversion: 2.1 time: 0.084404 Sep 01 16:35:15.377348 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 104/225] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:15 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:16.275876 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-83fdd776-0e94-45fc-96cb-a152b5cdbf22 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:16.276493 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-83fdd776-0e94-45fc-96cb-a152b5cdbf22 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:16.283970 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-83fdd776-0e94-45fc-96cb-a152b5cdbf22 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:16.284487 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-83fdd776-0e94-45fc-96cb-a152b5cdbf22 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:16.285056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-83fdd776-0e94-45fc-96cb-a152b5cdbf22 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:16.285754 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-83fdd776-0e94-45fc-96cb-a152b5cdbf22 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:16.286204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-83fdd776-0e94-45fc-96cb-a152b5cdbf22 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:16.286675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-83fdd776-0e94-45fc-96cb-a152b5cdbf22 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:16.398803 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-14f4760f-ec7d-40d1-bb43-51f47339f462 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:16.399400 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-14f4760f-ec7d-40d1-bb43-51f47339f462 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:16.405893 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-14f4760f-ec7d-40d1-bb43-51f47339f462 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:16.412842 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-14f4760f-ec7d-40d1-bb43-51f47339f462 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:16.413506 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-14f4760f-ec7d-40d1-bb43-51f47339f462 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:16.414006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-14f4760f-ec7d-40d1-bb43-51f47339f462 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:16.414653 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-14f4760f-ec7d-40d1-bb43-51f47339f462 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:16.414912 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-14f4760f-ec7d-40d1-bb43-51f47339f462 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:16.465477 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-83fdd776-0e94-45fc-96cb-a152b5cdbf22 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:16.473318 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-83fdd776-0e94-45fc-96cb-a152b5cdbf22 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.201546 Sep 01 16:35:16.474095 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 122/226] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:16 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:16.516735 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-14f4760f-ec7d-40d1-bb43-51f47339f462 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:16.525655 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-14f4760f-ec7d-40d1-bb43-51f47339f462 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 200 len: 1272 microversion: 2.1 time: 0.130560 Sep 01 16:35:16.527968 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 105/227] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:16 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 1272 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:17.393591 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-c1d3878d-8388-42de-aead-f33db7775b43 req-f32258c1-440d-4b4b-96fb-a1f2bdef6f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d892c9f-cd29-45a5-912a-292338f6f480", "tag": "fe2e7a5a-96ce-4069-adb2-e1db8651a186"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:17.404553 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-c1d3878d-8388-42de-aead-f33db7775b43 req-f32258c1-440d-4b4b-96fb-a1f2bdef6f26 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:17.405002 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-c1d3878d-8388-42de-aead-f33db7775b43 req-f32258c1-440d-4b4b-96fb-a1f2bdef6f26 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:17.405464 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-c1d3878d-8388-42de-aead-f33db7775b43 req-f32258c1-440d-4b4b-96fb-a1f2bdef6f26 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:17.419619 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-c1d3878d-8388-42de-aead-f33db7775b43 req-f32258c1-440d-4b4b-96fb-a1f2bdef6f26 service nova] Creating event network-changed:fe2e7a5a-96ce-4069-adb2-e1db8651a186 for instance 9d892c9f-cd29-45a5-912a-292338f6f480 on hv-cinder-85220 Sep 01 16:35:17.424369 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-c1d3878d-8388-42de-aead-f33db7775b43 req-f32258c1-440d-4b4b-96fb-a1f2bdef6f26 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035100 Sep 01 16:35:17.424964 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 123/228] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:35:17.497009 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f7df2c7d-066c-4ffd-a485-a0f8eec3b46a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:17.497522 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f7df2c7d-066c-4ffd-a485-a0f8eec3b46a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:17.503815 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f7df2c7d-066c-4ffd-a485-a0f8eec3b46a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:17.504354 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f7df2c7d-066c-4ffd-a485-a0f8eec3b46a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:17.504735 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f7df2c7d-066c-4ffd-a485-a0f8eec3b46a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:17.505427 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f7df2c7d-066c-4ffd-a485-a0f8eec3b46a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:17.506214 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f7df2c7d-066c-4ffd-a485-a0f8eec3b46a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:17.507005 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f7df2c7d-066c-4ffd-a485-a0f8eec3b46a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:17.549572 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c065e8ad-2378-45f2-baee-1044249736b4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:17.550647 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c065e8ad-2378-45f2-baee-1044249736b4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:17.557418 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c065e8ad-2378-45f2-baee-1044249736b4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:17.557902 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c065e8ad-2378-45f2-baee-1044249736b4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:17.558402 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c065e8ad-2378-45f2-baee-1044249736b4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:17.559096 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c065e8ad-2378-45f2-baee-1044249736b4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:17.559547 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c065e8ad-2378-45f2-baee-1044249736b4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:17.559995 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c065e8ad-2378-45f2-baee-1044249736b4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:17.704937 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c065e8ad-2378-45f2-baee-1044249736b4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:17.715132 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c065e8ad-2378-45f2-baee-1044249736b4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 200 len: 1314 microversion: 2.1 time: 0.169819 Sep 01 16:35:17.716102 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 124/229] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:17 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:17.725625 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f7df2c7d-066c-4ffd-a485-a0f8eec3b46a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:17.738094 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f7df2c7d-066c-4ffd-a485-a0f8eec3b46a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.245468 Sep 01 16:35:17.739410 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 106/230] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:17 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:18.737702 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e6399ff8-51f2-4087-812d-fbb9f8427424 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:18.738415 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e6399ff8-51f2-4087-812d-fbb9f8427424 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:18.746559 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6399ff8-51f2-4087-812d-fbb9f8427424 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:18.747140 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6399ff8-51f2-4087-812d-fbb9f8427424 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:18.747647 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6399ff8-51f2-4087-812d-fbb9f8427424 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:18.748445 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6399ff8-51f2-4087-812d-fbb9f8427424 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:18.749113 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6399ff8-51f2-4087-812d-fbb9f8427424 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:18.749605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6399ff8-51f2-4087-812d-fbb9f8427424 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:18.760797 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-cc26f04d-0f92-475b-981a-4b62962f5e82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:18.762133 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-cc26f04d-0f92-475b-981a-4b62962f5e82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:18.769344 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cc26f04d-0f92-475b-981a-4b62962f5e82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:18.770179 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cc26f04d-0f92-475b-981a-4b62962f5e82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:18.770655 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cc26f04d-0f92-475b-981a-4b62962f5e82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:18.771349 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cc26f04d-0f92-475b-981a-4b62962f5e82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:18.772482 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cc26f04d-0f92-475b-981a-4b62962f5e82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:18.773087 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cc26f04d-0f92-475b-981a-4b62962f5e82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:18.924054 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e6399ff8-51f2-4087-812d-fbb9f8427424 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:18.934221 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e6399ff8-51f2-4087-812d-fbb9f8427424 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 200 len: 1314 microversion: 2.1 time: 0.200161 Sep 01 16:35:18.935291 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 125/231] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:18 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:18.937675 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-cc26f04d-0f92-475b-981a-4b62962f5e82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:18.949987 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-cc26f04d-0f92-475b-981a-4b62962f5e82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.193235 Sep 01 16:35:18.950645 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 107/232] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:18 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:19.957627 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e2634cfb-03a0-401c-8ab1-1d97a0cf1063 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:19.958802 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e2634cfb-03a0-401c-8ab1-1d97a0cf1063 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:19.966597 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2634cfb-03a0-401c-8ab1-1d97a0cf1063 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:19.972259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-50757d71-62cc-4b41-b676-ffe07a411902 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:19.972848 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-50757d71-62cc-4b41-b676-ffe07a411902 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:19.976356 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2634cfb-03a0-401c-8ab1-1d97a0cf1063 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:19.976814 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2634cfb-03a0-401c-8ab1-1d97a0cf1063 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:19.977615 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2634cfb-03a0-401c-8ab1-1d97a0cf1063 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:19.978210 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2634cfb-03a0-401c-8ab1-1d97a0cf1063 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:19.978653 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2634cfb-03a0-401c-8ab1-1d97a0cf1063 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:19.984690 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-50757d71-62cc-4b41-b676-ffe07a411902 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:19.985869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-50757d71-62cc-4b41-b676-ffe07a411902 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:19.986578 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-50757d71-62cc-4b41-b676-ffe07a411902 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:19.987853 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-50757d71-62cc-4b41-b676-ffe07a411902 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:19.989332 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-50757d71-62cc-4b41-b676-ffe07a411902 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:19.990276 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-50757d71-62cc-4b41-b676-ffe07a411902 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:20.147043 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e2634cfb-03a0-401c-8ab1-1d97a0cf1063 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:20.155949 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e2634cfb-03a0-401c-8ab1-1d97a0cf1063 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 200 len: 1314 microversion: 2.1 time: 0.203234 Sep 01 16:35:20.156620 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 126/233] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:19 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:20.172263 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-307717bf-18f5-4b78-ae62-9a914fedda30 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:20.176351 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-307717bf-18f5-4b78-ae62-9a914fedda30 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:20.182806 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-307717bf-18f5-4b78-ae62-9a914fedda30 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:20.183393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-307717bf-18f5-4b78-ae62-9a914fedda30 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:20.183903 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-307717bf-18f5-4b78-ae62-9a914fedda30 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:20.184672 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-307717bf-18f5-4b78-ae62-9a914fedda30 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:20.185197 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-307717bf-18f5-4b78-ae62-9a914fedda30 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:20.185695 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-307717bf-18f5-4b78-ae62-9a914fedda30 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:20.213929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-307717bf-18f5-4b78-ae62-9a914fedda30 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:35:20.312831 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-307717bf-18f5-4b78-ae62-9a914fedda30 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 204 len: 0 microversion: 2.1 time: 0.143973 Sep 01 16:35:20.313658 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 127/234] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:35:20 2022] DELETE /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:35:20.321774 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c090c50a-8071-43b9-9e36-a56d9df1b745 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:20.322488 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c090c50a-8071-43b9-9e36-a56d9df1b745 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:20.328475 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c090c50a-8071-43b9-9e36-a56d9df1b745 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:20.329012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c090c50a-8071-43b9-9e36-a56d9df1b745 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:20.329682 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c090c50a-8071-43b9-9e36-a56d9df1b745 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:20.330089 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c090c50a-8071-43b9-9e36-a56d9df1b745 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:20.330579 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c090c50a-8071-43b9-9e36-a56d9df1b745 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:20.330991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c090c50a-8071-43b9-9e36-a56d9df1b745 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:20.379960 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-50757d71-62cc-4b41-b676-ffe07a411902 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:20.389306 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-50757d71-62cc-4b41-b676-ffe07a411902 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.420496 Sep 01 16:35:20.395635 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 108/235] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:19 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:20.469148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c090c50a-8071-43b9-9e36-a56d9df1b745 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:20.479580 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c090c50a-8071-43b9-9e36-a56d9df1b745 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1553 microversion: 2.1 time: 0.161436 Sep 01 16:35:20.480392 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 128/236] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:20 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:21.184142 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b5995b68-f110-4893-aa3f-a86109927bdc tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:21.185538 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b5995b68-f110-4893-aa3f-a86109927bdc tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:21.192184 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b5995b68-f110-4893-aa3f-a86109927bdc tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:21.193050 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b5995b68-f110-4893-aa3f-a86109927bdc tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:21.193699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b5995b68-f110-4893-aa3f-a86109927bdc tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:21.194546 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b5995b68-f110-4893-aa3f-a86109927bdc tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:21.195224 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b5995b68-f110-4893-aa3f-a86109927bdc tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:21.195637 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b5995b68-f110-4893-aa3f-a86109927bdc tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:21.412397 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8659149d-9081-4179-b3de-2720c5d61ec7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:21.413349 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8659149d-9081-4179-b3de-2720c5d61ec7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:21.423031 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8659149d-9081-4179-b3de-2720c5d61ec7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:21.423604 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8659149d-9081-4179-b3de-2720c5d61ec7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:21.424141 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8659149d-9081-4179-b3de-2720c5d61ec7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:21.424968 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8659149d-9081-4179-b3de-2720c5d61ec7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:21.425623 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8659149d-9081-4179-b3de-2720c5d61ec7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:21.427141 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8659149d-9081-4179-b3de-2720c5d61ec7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:21.517305 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b5995b68-f110-4893-aa3f-a86109927bdc tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:21.525687 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b5995b68-f110-4893-aa3f-a86109927bdc tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 200 len: 1314 microversion: 2.1 time: 0.345366 Sep 01 16:35:21.526366 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 109/237] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:21 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:21.531061 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-17436d0e-e39f-43f2-8ad4-1e601190f1d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:21.531719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-17436d0e-e39f-43f2-8ad4-1e601190f1d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:21.538178 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17436d0e-e39f-43f2-8ad4-1e601190f1d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:21.538762 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17436d0e-e39f-43f2-8ad4-1e601190f1d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:21.540194 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17436d0e-e39f-43f2-8ad4-1e601190f1d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:21.540194 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17436d0e-e39f-43f2-8ad4-1e601190f1d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:21.540533 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17436d0e-e39f-43f2-8ad4-1e601190f1d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:21.541006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17436d0e-e39f-43f2-8ad4-1e601190f1d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:21.667605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8659149d-9081-4179-b3de-2720c5d61ec7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:21.701726 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8659149d-9081-4179-b3de-2720c5d61ec7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.294544 Sep 01 16:35:21.707561 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 129/238] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:21 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:21.720638 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-17436d0e-e39f-43f2-8ad4-1e601190f1d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:21.729598 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-17436d0e-e39f-43f2-8ad4-1e601190f1d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1553 microversion: 2.1 time: 0.201821 Sep 01 16:35:21.730524 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 110/239] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:21 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:22.557768 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8cb5ea4e-2d8f-4706-9c58-e01c3e4a8a6c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:22.558281 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8cb5ea4e-2d8f-4706-9c58-e01c3e4a8a6c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:22.566199 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8cb5ea4e-2d8f-4706-9c58-e01c3e4a8a6c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:22.567100 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8cb5ea4e-2d8f-4706-9c58-e01c3e4a8a6c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:22.567739 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8cb5ea4e-2d8f-4706-9c58-e01c3e4a8a6c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:22.570726 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8cb5ea4e-2d8f-4706-9c58-e01c3e4a8a6c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:22.572062 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8cb5ea4e-2d8f-4706-9c58-e01c3e4a8a6c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:22.573219 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8cb5ea4e-2d8f-4706-9c58-e01c3e4a8a6c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:22.731147 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-2a016ae9-3c19-4d1c-8b57-190bdb01a330 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:22.731824 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-2a016ae9-3c19-4d1c-8b57-190bdb01a330 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:22.742833 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a016ae9-3c19-4d1c-8b57-190bdb01a330 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:22.747595 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8cb5ea4e-2d8f-4706-9c58-e01c3e4a8a6c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:22.747891 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a016ae9-3c19-4d1c-8b57-190bdb01a330 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:22.748676 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a016ae9-3c19-4d1c-8b57-190bdb01a330 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:22.751580 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a016ae9-3c19-4d1c-8b57-190bdb01a330 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:22.753149 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a016ae9-3c19-4d1c-8b57-190bdb01a330 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:22.753608 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a016ae9-3c19-4d1c-8b57-190bdb01a330 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:22.760692 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8cb5ea4e-2d8f-4706-9c58-e01c3e4a8a6c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 200 len: 1314 microversion: 2.1 time: 0.204944 Sep 01 16:35:22.761545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 130/240] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:22 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:22.775562 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-610a15a7-0999-48ba-b52f-5de2d0443477 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:22.781371 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-610a15a7-0999-48ba-b52f-5de2d0443477 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:22.791538 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-610a15a7-0999-48ba-b52f-5de2d0443477 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:22.792375 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-610a15a7-0999-48ba-b52f-5de2d0443477 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:22.792951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-610a15a7-0999-48ba-b52f-5de2d0443477 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:22.794118 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-610a15a7-0999-48ba-b52f-5de2d0443477 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:22.794816 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-610a15a7-0999-48ba-b52f-5de2d0443477 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:22.795461 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-610a15a7-0999-48ba-b52f-5de2d0443477 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:22.926771 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2a016ae9-3c19-4d1c-8b57-190bdb01a330 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:22.938763 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-2a016ae9-3c19-4d1c-8b57-190bdb01a330 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.214934 Sep 01 16:35:22.939849 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 111/241] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:22 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:22.980196 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-610a15a7-0999-48ba-b52f-5de2d0443477 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:22.991140 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-610a15a7-0999-48ba-b52f-5de2d0443477 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1553 microversion: 2.1 time: 0.226846 Sep 01 16:35:22.992220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 131/242] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:22 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1553 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:23.783516 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-095573cf-eff6-4d77-bd6a-409fca4405e2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:23.784700 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-095573cf-eff6-4d77-bd6a-409fca4405e2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:23.791387 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-095573cf-eff6-4d77-bd6a-409fca4405e2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:23.791981 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-095573cf-eff6-4d77-bd6a-409fca4405e2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:23.792557 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-095573cf-eff6-4d77-bd6a-409fca4405e2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:23.798656 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-095573cf-eff6-4d77-bd6a-409fca4405e2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:23.798656 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-095573cf-eff6-4d77-bd6a-409fca4405e2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:23.798656 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-095573cf-eff6-4d77-bd6a-409fca4405e2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:23.864311 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-2a02b235-ce68-4b72-814a-90305ca97696 req-0bf5fac2-98a3-4734-82b4-09bca0f6b864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d892c9f-cd29-45a5-912a-292338f6f480", "name": "network-vif-plugged", "status": "completed", "tag": "fe2e7a5a-96ce-4069-adb2-e1db8651a186"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:23.884526 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-2a02b235-ce68-4b72-814a-90305ca97696 req-0bf5fac2-98a3-4734-82b4-09bca0f6b864 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:23.885227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-2a02b235-ce68-4b72-814a-90305ca97696 req-0bf5fac2-98a3-4734-82b4-09bca0f6b864 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:23.885667 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-2a02b235-ce68-4b72-814a-90305ca97696 req-0bf5fac2-98a3-4734-82b4-09bca0f6b864 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:23.910604 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-2a02b235-ce68-4b72-814a-90305ca97696 req-0bf5fac2-98a3-4734-82b4-09bca0f6b864 service nova] Creating event network-vif-plugged:fe2e7a5a-96ce-4069-adb2-e1db8651a186 for instance 9d892c9f-cd29-45a5-912a-292338f6f480 on hv-cinder-85220 Sep 01 16:35:23.920571 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-2a02b235-ce68-4b72-814a-90305ca97696 req-0bf5fac2-98a3-4734-82b4-09bca0f6b864 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061687 Sep 01 16:35:23.927155 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 132/243] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:35:23.962842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-64e4afc6-ca1f-410a-beea-f212ec2afe43 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:23.964382 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-64e4afc6-ca1f-410a-beea-f212ec2afe43 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:23.978688 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-64e4afc6-ca1f-410a-beea-f212ec2afe43 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:23.979552 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-64e4afc6-ca1f-410a-beea-f212ec2afe43 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:23.980041 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-64e4afc6-ca1f-410a-beea-f212ec2afe43 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:23.980870 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-64e4afc6-ca1f-410a-beea-f212ec2afe43 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:23.981701 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-64e4afc6-ca1f-410a-beea-f212ec2afe43 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:23.982131 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-64e4afc6-ca1f-410a-beea-f212ec2afe43 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:23.990892 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:24.096489 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:24.119456 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=6 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:24.128285 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-095573cf-eff6-4d77-bd6a-409fca4405e2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:24.141594 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-095573cf-eff6-4d77-bd6a-409fca4405e2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 200 len: 1314 microversion: 2.1 time: 0.360283 Sep 01 16:35:24.142973 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 112/244] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:23 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:24.150681 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e1d7afe1-fdeb-4d51-b6c1-350758f25273 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:24.153772 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-e1d7afe1-fdeb-4d51-b6c1-350758f25273 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:24.167324 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e1d7afe1-fdeb-4d51-b6c1-350758f25273 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:24.170099 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e1d7afe1-fdeb-4d51-b6c1-350758f25273 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:24.170761 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e1d7afe1-fdeb-4d51-b6c1-350758f25273 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:24.174171 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e1d7afe1-fdeb-4d51-b6c1-350758f25273 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:24.174891 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e1d7afe1-fdeb-4d51-b6c1-350758f25273 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:24.176139 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e1d7afe1-fdeb-4d51-b6c1-350758f25273 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:24.185726 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=100 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:24.239423 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-64e4afc6-ca1f-410a-beea-f212ec2afe43 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:24.251808 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-64e4afc6-ca1f-410a-beea-f212ec2afe43 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.295471 Sep 01 16:35:24.258853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 133/245] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:23 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:24.273412 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:24.644632 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e1d7afe1-fdeb-4d51-b6c1-350758f25273 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:24.653599 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-e1d7afe1-fdeb-4d51-b6c1-350758f25273 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1553 microversion: 2.1 time: 0.509354 Sep 01 16:35:24.674014 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 113/246] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:24 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1553 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:25.124794 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-3f99a367-d3b1-41d1-a5f5-93d316477c64 req-5ba35ec4-d6d1-4d0f-8419-2ec2e385879f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af33e17-eea1-4429-bca2-299dc3f02bf8", "name": "network-vif-deleted", "tag": "b086b899-9326-4795-b2fc-0c23a4a38451"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:25.138187 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-3f99a367-d3b1-41d1-a5f5-93d316477c64 req-5ba35ec4-d6d1-4d0f-8419-2ec2e385879f service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:25.138688 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-3f99a367-d3b1-41d1-a5f5-93d316477c64 req-5ba35ec4-d6d1-4d0f-8419-2ec2e385879f service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:25.139105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-3f99a367-d3b1-41d1-a5f5-93d316477c64 req-5ba35ec4-d6d1-4d0f-8419-2ec2e385879f service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:25.150759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-3f99a367-d3b1-41d1-a5f5-93d316477c64 req-5ba35ec4-d6d1-4d0f-8419-2ec2e385879f service nova] Creating event network-vif-deleted:b086b899-9326-4795-b2fc-0c23a4a38451 for instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 on hv-cinder-85220 Sep 01 16:35:25.155780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-3f99a367-d3b1-41d1-a5f5-93d316477c64 req-5ba35ec4-d6d1-4d0f-8419-2ec2e385879f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034821 Sep 01 16:35:25.156607 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 134/247] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:35:25.164848 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-2e7bc0de-1e3c-43b6-92e9-cca55357ae4c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:25.166092 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-2e7bc0de-1e3c-43b6-92e9-cca55357ae4c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:25.172175 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2e7bc0de-1e3c-43b6-92e9-cca55357ae4c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:25.172659 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2e7bc0de-1e3c-43b6-92e9-cca55357ae4c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:25.173085 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2e7bc0de-1e3c-43b6-92e9-cca55357ae4c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:25.173868 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2e7bc0de-1e3c-43b6-92e9-cca55357ae4c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:25.174606 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2e7bc0de-1e3c-43b6-92e9-cca55357ae4c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:25.175244 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2e7bc0de-1e3c-43b6-92e9-cca55357ae4c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:25.273880 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b9c22f9d-352d-43f8-a2ea-dfceee70de71 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:25.274732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b9c22f9d-352d-43f8-a2ea-dfceee70de71 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:25.286689 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9c22f9d-352d-43f8-a2ea-dfceee70de71 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:25.287308 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9c22f9d-352d-43f8-a2ea-dfceee70de71 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:25.288158 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9c22f9d-352d-43f8-a2ea-dfceee70de71 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:25.288824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9c22f9d-352d-43f8-a2ea-dfceee70de71 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:25.289699 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9c22f9d-352d-43f8-a2ea-dfceee70de71 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:25.291440 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9c22f9d-352d-43f8-a2ea-dfceee70de71 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:25.326615 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2e7bc0de-1e3c-43b6-92e9-cca55357ae4c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:25.335995 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-2e7bc0de-1e3c-43b6-92e9-cca55357ae4c tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 200 len: 1314 microversion: 2.1 time: 0.176669 Sep 01 16:35:25.337128 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 114/248] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:25 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:25.474206 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b9c22f9d-352d-43f8-a2ea-dfceee70de71 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:25.483680 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b9c22f9d-352d-43f8-a2ea-dfceee70de71 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.213891 Sep 01 16:35:25.510559 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 135/249] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:25 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:25.681651 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-59ff22ca-9414-408e-b712-3463dbe4e3eb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:25.682823 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-59ff22ca-9414-408e-b712-3463dbe4e3eb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:25.689715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59ff22ca-9414-408e-b712-3463dbe4e3eb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:25.690278 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59ff22ca-9414-408e-b712-3463dbe4e3eb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:25.690871 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59ff22ca-9414-408e-b712-3463dbe4e3eb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:25.692135 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59ff22ca-9414-408e-b712-3463dbe4e3eb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:25.693034 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59ff22ca-9414-408e-b712-3463dbe4e3eb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:25.694157 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59ff22ca-9414-408e-b712-3463dbe4e3eb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:25.773721 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-59ff22ca-9414-408e-b712-3463dbe4e3eb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:25.782746 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-59ff22ca-9414-408e-b712-3463dbe4e3eb tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1345 microversion: 2.1 time: 0.105465 Sep 01 16:35:25.783313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 115/250] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:25 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:26.357238 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e050d08a-050c-47ea-ae98-4fbae80c42e4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:26.357847 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e050d08a-050c-47ea-ae98-4fbae80c42e4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:26.365170 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e050d08a-050c-47ea-ae98-4fbae80c42e4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:26.365847 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e050d08a-050c-47ea-ae98-4fbae80c42e4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:26.366459 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e050d08a-050c-47ea-ae98-4fbae80c42e4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:26.367535 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e050d08a-050c-47ea-ae98-4fbae80c42e4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:26.368674 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e050d08a-050c-47ea-ae98-4fbae80c42e4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:26.369346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e050d08a-050c-47ea-ae98-4fbae80c42e4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:26.516639 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-cff9c473-8599-4e6e-a8d3-714ef60ac555 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:26.517416 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-cff9c473-8599-4e6e-a8d3-714ef60ac555 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:26.524987 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cff9c473-8599-4e6e-a8d3-714ef60ac555 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:26.525573 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cff9c473-8599-4e6e-a8d3-714ef60ac555 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:26.526119 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cff9c473-8599-4e6e-a8d3-714ef60ac555 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:26.526987 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cff9c473-8599-4e6e-a8d3-714ef60ac555 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:26.527509 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cff9c473-8599-4e6e-a8d3-714ef60ac555 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:26.528000 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cff9c473-8599-4e6e-a8d3-714ef60ac555 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:26.679798 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e050d08a-050c-47ea-ae98-4fbae80c42e4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:26.688793 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e050d08a-050c-47ea-ae98-4fbae80c42e4 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 200 len: 1314 microversion: 2.1 time: 0.335660 Sep 01 16:35:26.689353 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 136/251] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:26 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:26.715704 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-cff9c473-8599-4e6e-a8d3-714ef60ac555 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:26.725152 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-cff9c473-8599-4e6e-a8d3-714ef60ac555 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.212572 Sep 01 16:35:26.725941 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 116/252] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:26 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:26.803002 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f2866d84-50e7-4d37-9d26-78b51b24dfba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:26.803597 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f2866d84-50e7-4d37-9d26-78b51b24dfba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:26.805555 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:26.811701 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f2866d84-50e7-4d37-9d26-78b51b24dfba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:26.812174 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f2866d84-50e7-4d37-9d26-78b51b24dfba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:26.812598 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f2866d84-50e7-4d37-9d26-78b51b24dfba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:26.813292 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f2866d84-50e7-4d37-9d26-78b51b24dfba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:26.813721 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f2866d84-50e7-4d37-9d26-78b51b24dfba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:26.814170 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f2866d84-50e7-4d37-9d26-78b51b24dfba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:26.845193 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f2866d84-50e7-4d37-9d26-78b51b24dfba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:26.845664 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f2866d84-50e7-4d37-9d26-78b51b24dfba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:26.846138 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f2866d84-50e7-4d37-9d26-78b51b24dfba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:26.846600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-f2866d84-50e7-4d37-9d26-78b51b24dfba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lazy-loading 'fault' on Instance uuid 6af33e17-eea1-4429-bca2-299dc3f02bf8 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:35:26.891941 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f2866d84-50e7-4d37-9d26-78b51b24dfba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:26.900245 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f2866d84-50e7-4d37-9d26-78b51b24dfba tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1350 microversion: 2.1 time: 0.101079 Sep 01 16:35:26.900812 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 137/253] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:26 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:27.711785 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-3857c155-bc11-469b-8a0b-65f9f57a9a42 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:27.712388 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-3857c155-bc11-469b-8a0b-65f9f57a9a42 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:27.718440 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3857c155-bc11-469b-8a0b-65f9f57a9a42 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:27.718912 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3857c155-bc11-469b-8a0b-65f9f57a9a42 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:27.719343 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3857c155-bc11-469b-8a0b-65f9f57a9a42 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:27.720014 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3857c155-bc11-469b-8a0b-65f9f57a9a42 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:27.720493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3857c155-bc11-469b-8a0b-65f9f57a9a42 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:27.720936 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3857c155-bc11-469b-8a0b-65f9f57a9a42 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:27.748801 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dabf4b7e-235d-43b2-9fc1-37200c8f655f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:27.749400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-dabf4b7e-235d-43b2-9fc1-37200c8f655f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:27.755841 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dabf4b7e-235d-43b2-9fc1-37200c8f655f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:27.756314 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dabf4b7e-235d-43b2-9fc1-37200c8f655f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:27.756776 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dabf4b7e-235d-43b2-9fc1-37200c8f655f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:27.757460 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dabf4b7e-235d-43b2-9fc1-37200c8f655f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:27.757900 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dabf4b7e-235d-43b2-9fc1-37200c8f655f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:27.758345 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dabf4b7e-235d-43b2-9fc1-37200c8f655f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:27.887138 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dabf4b7e-235d-43b2-9fc1-37200c8f655f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:27.895124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-dabf4b7e-235d-43b2-9fc1-37200c8f655f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.150402 Sep 01 16:35:27.895683 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 138/254] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:27 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:27.921446 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d0c063b5-2845-407f-9e93-5ec58f92c7d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:27.922295 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d0c063b5-2845-407f-9e93-5ec58f92c7d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:27.928253 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0c063b5-2845-407f-9e93-5ec58f92c7d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:27.928815 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0c063b5-2845-407f-9e93-5ec58f92c7d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:27.929371 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0c063b5-2845-407f-9e93-5ec58f92c7d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:27.930065 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0c063b5-2845-407f-9e93-5ec58f92c7d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:27.930699 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0c063b5-2845-407f-9e93-5ec58f92c7d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:27.931149 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0c063b5-2845-407f-9e93-5ec58f92c7d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:27.963965 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0c063b5-2845-407f-9e93-5ec58f92c7d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:27.964451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0c063b5-2845-407f-9e93-5ec58f92c7d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:27.964877 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0c063b5-2845-407f-9e93-5ec58f92c7d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:27.965307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-d0c063b5-2845-407f-9e93-5ec58f92c7d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lazy-loading 'fault' on Instance uuid 6af33e17-eea1-4429-bca2-299dc3f02bf8 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:35:28.009243 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d0c063b5-2845-407f-9e93-5ec58f92c7d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:28.018149 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d0c063b5-2845-407f-9e93-5ec58f92c7d4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1350 microversion: 2.1 time: 0.100545 Sep 01 16:35:28.018757 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 139/255] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:27 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:28.059116 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-3857c155-bc11-469b-8a0b-65f9f57a9a42 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:28.073112 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-3857c155-bc11-469b-8a0b-65f9f57a9a42 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 200 len: 1498 microversion: 2.1 time: 0.365219 Sep 01 16:35:28.073826 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 117/256] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:27 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 1498 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:28.916318 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8171b88c-3e09-47f2-b35b-78f2ed9b1118 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:28.916923 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8171b88c-3e09-47f2-b35b-78f2ed9b1118 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:28.923790 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8171b88c-3e09-47f2-b35b-78f2ed9b1118 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:28.924268 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8171b88c-3e09-47f2-b35b-78f2ed9b1118 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:28.924724 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8171b88c-3e09-47f2-b35b-78f2ed9b1118 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:28.925411 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8171b88c-3e09-47f2-b35b-78f2ed9b1118 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:28.925862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8171b88c-3e09-47f2-b35b-78f2ed9b1118 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:28.926310 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8171b88c-3e09-47f2-b35b-78f2ed9b1118 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:29.039308 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-169c396a-59af-4e74-9eff-6ea134afbcee tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:29.040424 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-169c396a-59af-4e74-9eff-6ea134afbcee tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:29.047699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-169c396a-59af-4e74-9eff-6ea134afbcee tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:29.048172 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-169c396a-59af-4e74-9eff-6ea134afbcee tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:29.048590 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-169c396a-59af-4e74-9eff-6ea134afbcee tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:29.049271 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-169c396a-59af-4e74-9eff-6ea134afbcee tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:29.049706 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-169c396a-59af-4e74-9eff-6ea134afbcee tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:29.050116 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-169c396a-59af-4e74-9eff-6ea134afbcee tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:29.077931 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8171b88c-3e09-47f2-b35b-78f2ed9b1118 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:29.085544 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8171b88c-3e09-47f2-b35b-78f2ed9b1118 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.173819 Sep 01 16:35:29.086112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 140/257] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:28 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:29.093121 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-169c396a-59af-4e74-9eff-6ea134afbcee tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:29.093690 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-169c396a-59af-4e74-9eff-6ea134afbcee tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:29.094028 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-169c396a-59af-4e74-9eff-6ea134afbcee tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:29.094510 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.objects.instance [None req-169c396a-59af-4e74-9eff-6ea134afbcee tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lazy-loading 'fault' on Instance uuid 6af33e17-eea1-4429-bca2-299dc3f02bf8 {{(pid=127178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:35:29.141712 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-169c396a-59af-4e74-9eff-6ea134afbcee tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b172f56cbd604342ba6d8169c969e157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c40a340919a49cc8b73687df600e2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:29.149958 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-169c396a-59af-4e74-9eff-6ea134afbcee tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 200 len: 1350 microversion: 2.1 time: 0.114384 Sep 01 16:35:29.150557 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 118/258] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:29 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 1350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:30.107411 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-aa68ebb4-8b78-4083-ada8-b82b247b9b8a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:30.108144 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-aa68ebb4-8b78-4083-ada8-b82b247b9b8a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:30.114969 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa68ebb4-8b78-4083-ada8-b82b247b9b8a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.115677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa68ebb4-8b78-4083-ada8-b82b247b9b8a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.116286 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa68ebb4-8b78-4083-ada8-b82b247b9b8a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.117159 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa68ebb4-8b78-4083-ada8-b82b247b9b8a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.117609 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa68ebb4-8b78-4083-ada8-b82b247b9b8a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.118030 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa68ebb4-8b78-4083-ada8-b82b247b9b8a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.169853 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7a73916e-215d-4586-904b-02f4d08e08e7 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:30.170982 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7a73916e-215d-4586-904b-02f4d08e08e7 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:30.176841 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7a73916e-215d-4586-904b-02f4d08e08e7 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.177548 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7a73916e-215d-4586-904b-02f4d08e08e7 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.178393 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7a73916e-215d-4586-904b-02f4d08e08e7 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.179372 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7a73916e-215d-4586-904b-02f4d08e08e7 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.179980 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7a73916e-215d-4586-904b-02f4d08e08e7 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.180434 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7a73916e-215d-4586-904b-02f4d08e08e7 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.209006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7a73916e-215d-4586-904b-02f4d08e08e7 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Going to try to terminate instance {{(pid=127178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:35:30.301439 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-aa68ebb4-8b78-4083-ada8-b82b247b9b8a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:30.311053 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-aa68ebb4-8b78-4083-ada8-b82b247b9b8a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.208460 Sep 01 16:35:30.312031 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 141/259] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:30 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:30.316948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-117a54d7-caca-41ca-9235-68d05016909c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:30.318074 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-117a54d7-caca-41ca-9235-68d05016909c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:30.324465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-117a54d7-caca-41ca-9235-68d05016909c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.325227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-117a54d7-caca-41ca-9235-68d05016909c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.326016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-117a54d7-caca-41ca-9235-68d05016909c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.327005 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-117a54d7-caca-41ca-9235-68d05016909c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.327826 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-117a54d7-caca-41ca-9235-68d05016909c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.328581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-117a54d7-caca-41ca-9235-68d05016909c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.343468 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-117a54d7-caca-41ca-9235-68d05016909c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] HTTP exception thrown: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-117a54d7-caca-41ca-9235-68d05016909c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Request method failure captured: Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 HTTP/1.1 Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN78DQFgJI-F0Z5_R-fpp6Krezi3VA4ukMiYCbyzbOXqSu6hVah2BxBVlKt0M8P_CcU-JdK3SobvjmKeU3WJSnXMjqvG8tkcItsMfOcg3vGul-tzK_UVwmNepJVtAVYRa8iCY5xgMORtVLTBoBfaLt80DU48qmaCF-8167aMhuAzhG4 Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 5c40a340919a49cc8b73687df600e2ea Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-DeleteServersTestJSON-1059093282 Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:35:30.349334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:35:30.350753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c40a340919a49cc8b73687df600e2ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c40a340919a49cc8b73687df600e2ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c40a340919a49cc8b73687df600e2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c40a340919a49cc8b73687df600e2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:35:30.350753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-DeleteServersTestJSON-1059093282 Sep 01 16:35:30.350753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 5c40a340919a49cc8b73687df600e2ea Sep 01 16:35:30.350753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-DeleteServersTestJSON-1059093282 Sep 01 16:35:30.350753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-DeleteServersTestJSON-1059093282-project Sep 01 16:35:30.350753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:35:30.350753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:35:30.350753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: b172f56cbd604342ba6d8169c969e157 Sep 01 16:35:30.350753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-DeleteServersTestJSON-1059093282-project Sep 01 16:35:30.350753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:35:30.350753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:30.350753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': '6af33e17-eea1-4429-bca2-299dc3f02bf8'} Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:35:30.351478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:30.353322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:30.357085 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-117a54d7-caca-41ca-9235-68d05016909c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Returning 404 to user: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:35:30.359153 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-117a54d7-caca-41ca-9235-68d05016909c tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 404 len: 111 microversion: 2.1 time: 0.045066 Sep 01 16:35:30.359981 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 142/260] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:30 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:35:30.369055 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7a73916e-215d-4586-904b-02f4d08e08e7 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 204 len: 0 microversion: 2.1 time: 0.203609 Sep 01 16:35:30.370018 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 119/261] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:35:30 2022] DELETE /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 16:35:30.381617 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9c3081e0-afe1-41b7-be76-e7e897013878 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:30.381950 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9c3081e0-afe1-41b7-be76-e7e897013878 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:30.395077 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c3081e0-afe1-41b7-be76-e7e897013878 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.395559 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c3081e0-afe1-41b7-be76-e7e897013878 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.395985 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c3081e0-afe1-41b7-be76-e7e897013878 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.396752 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c3081e0-afe1-41b7-be76-e7e897013878 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.397206 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c3081e0-afe1-41b7-be76-e7e897013878 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.397624 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c3081e0-afe1-41b7-be76-e7e897013878 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.550599 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9c3081e0-afe1-41b7-be76-e7e897013878 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:30.559446 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9c3081e0-afe1-41b7-be76-e7e897013878 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 200 len: 1504 microversion: 2.1 time: 0.184554 Sep 01 16:35:30.560018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 143/262] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:30 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:30.639934 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7784d9a6-1d67-4daf-81ff-c05ca13065c3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:30.644083 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7784d9a6-1d67-4daf-81ff-c05ca13065c3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:30.652827 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7784d9a6-1d67-4daf-81ff-c05ca13065c3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.653357 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7784d9a6-1d67-4daf-81ff-c05ca13065c3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.653858 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7784d9a6-1d67-4daf-81ff-c05ca13065c3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.654682 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7784d9a6-1d67-4daf-81ff-c05ca13065c3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.655127 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7784d9a6-1d67-4daf-81ff-c05ca13065c3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.655644 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7784d9a6-1d67-4daf-81ff-c05ca13065c3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.669416 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-7784d9a6-1d67-4daf-81ff-c05ca13065c3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] HTTP exception thrown: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7784d9a6-1d67-4daf-81ff-c05ca13065c3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Request method failure captured: Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8/os-volume_attachments HTTP/1.1 Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN78DQFgJI-F0Z5_R-fpp6Krezi3VA4ukMiYCbyzbOXqSu6hVah2BxBVlKt0M8P_CcU-JdK3SobvjmKeU3WJSnXMjqvG8tkcItsMfOcg3vGul-tzK_UVwmNepJVtAVYRa8iCY5xgMORtVLTBoBfaLt80DU48qmaCF-8167aMhuAzhG4 Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: 5c40a340919a49cc8b73687df600e2ea Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-DeleteServersTestJSON-1059093282 Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:35:30.673720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:35:30.675226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c40a340919a49cc8b73687df600e2ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c40a340919a49cc8b73687df600e2ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c40a340919a49cc8b73687df600e2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c40a340919a49cc8b73687df600e2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:35:30.675226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-DeleteServersTestJSON-1059093282 Sep 01 16:35:30.675226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: 5c40a340919a49cc8b73687df600e2ea Sep 01 16:35:30.675226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-DeleteServersTestJSON-1059093282 Sep 01 16:35:30.675226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-DeleteServersTestJSON-1059093282-project Sep 01 16:35:30.675226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:35:30.675226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:35:30.675226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: b172f56cbd604342ba6d8169c969e157 Sep 01 16:35:30.675226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-DeleteServersTestJSON-1059093282-project Sep 01 16:35:30.675226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:35:30.675226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:30.675226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'server_id': '6af33e17-eea1-4429-bca2-299dc3f02bf8'} Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:35:30.675990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:30.677023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:35:30.678073 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7784d9a6-1d67-4daf-81ff-c05ca13065c3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Returning 404 to user: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:35:30.678073 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7784d9a6-1d67-4daf-81ff-c05ca13065c3 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041280 Sep 01 16:35:30.678073 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 120/263] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:35:30 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:35:31.332398 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-30d07589-a3a9-4795-a88b-759b57573a9a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:31.332990 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-30d07589-a3a9-4795-a88b-759b57573a9a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:31.339921 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-30d07589-a3a9-4795-a88b-759b57573a9a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:31.340399 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-30d07589-a3a9-4795-a88b-759b57573a9a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:31.340827 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-30d07589-a3a9-4795-a88b-759b57573a9a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:31.341506 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-30d07589-a3a9-4795-a88b-759b57573a9a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:31.341953 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-30d07589-a3a9-4795-a88b-759b57573a9a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:31.342403 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-30d07589-a3a9-4795-a88b-759b57573a9a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:31.482564 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-30d07589-a3a9-4795-a88b-759b57573a9a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:31.490547 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-30d07589-a3a9-4795-a88b-759b57573a9a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.161952 Sep 01 16:35:31.491112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 144/264] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:31 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:31.581115 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-09c09d42-2705-4084-aaab-6e8cd2eaacf6 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:31.581716 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-09c09d42-2705-4084-aaab-6e8cd2eaacf6 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:31.587715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09c09d42-2705-4084-aaab-6e8cd2eaacf6 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:31.588184 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09c09d42-2705-4084-aaab-6e8cd2eaacf6 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:31.588611 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09c09d42-2705-4084-aaab-6e8cd2eaacf6 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:31.589279 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09c09d42-2705-4084-aaab-6e8cd2eaacf6 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:31.589719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09c09d42-2705-4084-aaab-6e8cd2eaacf6 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:31.590131 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09c09d42-2705-4084-aaab-6e8cd2eaacf6 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:31.717246 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-09c09d42-2705-4084-aaab-6e8cd2eaacf6 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:31.724943 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-09c09d42-2705-4084-aaab-6e8cd2eaacf6 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 200 len: 1504 microversion: 2.1 time: 0.147754 Sep 01 16:35:31.725498 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 121/265] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:31 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:32.511420 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6d8f4f40-6837-4b5a-b70f-6ac153919365 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:32.512041 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6d8f4f40-6837-4b5a-b70f-6ac153919365 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:32.518416 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6d8f4f40-6837-4b5a-b70f-6ac153919365 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:32.518890 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6d8f4f40-6837-4b5a-b70f-6ac153919365 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:32.519315 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6d8f4f40-6837-4b5a-b70f-6ac153919365 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:32.519983 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6d8f4f40-6837-4b5a-b70f-6ac153919365 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:32.520425 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6d8f4f40-6837-4b5a-b70f-6ac153919365 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:32.520841 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6d8f4f40-6837-4b5a-b70f-6ac153919365 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:32.649055 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6d8f4f40-6837-4b5a-b70f-6ac153919365 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:32.657089 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6d8f4f40-6837-4b5a-b70f-6ac153919365 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.149744 Sep 01 16:35:32.657651 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 145/266] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:32 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:32.745810 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-309b92e0-5b7e-4667-9a62-0b44ece7bbe2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:32.746438 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-309b92e0-5b7e-4667-9a62-0b44ece7bbe2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:32.752246 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-309b92e0-5b7e-4667-9a62-0b44ece7bbe2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:32.752719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-309b92e0-5b7e-4667-9a62-0b44ece7bbe2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:32.753147 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-309b92e0-5b7e-4667-9a62-0b44ece7bbe2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:32.753818 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-309b92e0-5b7e-4667-9a62-0b44ece7bbe2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:32.754287 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-309b92e0-5b7e-4667-9a62-0b44ece7bbe2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:32.754752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-309b92e0-5b7e-4667-9a62-0b44ece7bbe2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:32.878109 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-309b92e0-5b7e-4667-9a62-0b44ece7bbe2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:32.886140 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-309b92e0-5b7e-4667-9a62-0b44ece7bbe2 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 200 len: 1504 microversion: 2.1 time: 0.144064 Sep 01 16:35:32.886737 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 122/267] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:32 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 1504 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:33.679708 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5e6624cf-f3af-411c-85bf-20afa9ecefff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:33.681285 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5e6624cf-f3af-411c-85bf-20afa9ecefff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:33.687681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e6624cf-f3af-411c-85bf-20afa9ecefff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:33.688161 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e6624cf-f3af-411c-85bf-20afa9ecefff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:33.688590 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e6624cf-f3af-411c-85bf-20afa9ecefff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:33.689273 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e6624cf-f3af-411c-85bf-20afa9ecefff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:33.689721 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e6624cf-f3af-411c-85bf-20afa9ecefff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:33.690136 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e6624cf-f3af-411c-85bf-20afa9ecefff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:33.817791 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5e6624cf-f3af-411c-85bf-20afa9ecefff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:33.825881 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5e6624cf-f3af-411c-85bf-20afa9ecefff tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.151524 Sep 01 16:35:33.826458 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 146/268] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:33 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:33.906625 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b1420999-435b-464e-bd21-21bbd1c08739 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:33.907123 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b1420999-435b-464e-bd21-21bbd1c08739 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:33.913042 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1420999-435b-464e-bd21-21bbd1c08739 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:33.913518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1420999-435b-464e-bd21-21bbd1c08739 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:33.913947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1420999-435b-464e-bd21-21bbd1c08739 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:33.914655 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1420999-435b-464e-bd21-21bbd1c08739 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:33.915781 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1420999-435b-464e-bd21-21bbd1c08739 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:33.916208 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1420999-435b-464e-bd21-21bbd1c08739 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:34.049974 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b1420999-435b-464e-bd21-21bbd1c08739 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:34.057619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b1420999-435b-464e-bd21-21bbd1c08739 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 200 len: 1504 microversion: 2.1 time: 0.154875 Sep 01 16:35:34.058179 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 123/269] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:33 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:34.771647 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-e868ef07-faaa-4895-aa4f-367c26bf62db req-58191de4-868f-47e3-a593-3bfebcf5eaf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d892c9f-cd29-45a5-912a-292338f6f480", "name": "network-vif-deleted", "tag": "fe2e7a5a-96ce-4069-adb2-e1db8651a186"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:34.786702 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e868ef07-faaa-4895-aa4f-367c26bf62db req-58191de4-868f-47e3-a593-3bfebcf5eaf4 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:34.787220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e868ef07-faaa-4895-aa4f-367c26bf62db req-58191de4-868f-47e3-a593-3bfebcf5eaf4 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:34.787795 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e868ef07-faaa-4895-aa4f-367c26bf62db req-58191de4-868f-47e3-a593-3bfebcf5eaf4 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:34.800221 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-e868ef07-faaa-4895-aa4f-367c26bf62db req-58191de4-868f-47e3-a593-3bfebcf5eaf4 service nova] Creating event network-vif-deleted:fe2e7a5a-96ce-4069-adb2-e1db8651a186 for instance 9d892c9f-cd29-45a5-912a-292338f6f480 on hv-cinder-85220 Sep 01 16:35:34.805394 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-e868ef07-faaa-4895-aa4f-367c26bf62db req-58191de4-868f-47e3-a593-3bfebcf5eaf4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037447 Sep 01 16:35:34.806748 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 147/270] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:35:34.847842 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-5a540409-a989-42ce-9e98-2035f8a4d091 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:34.848756 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-5a540409-a989-42ce-9e98-2035f8a4d091 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:34.858446 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5a540409-a989-42ce-9e98-2035f8a4d091 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:34.860520 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5a540409-a989-42ce-9e98-2035f8a4d091 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:34.861542 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5a540409-a989-42ce-9e98-2035f8a4d091 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:34.862266 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5a540409-a989-42ce-9e98-2035f8a4d091 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:34.862996 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5a540409-a989-42ce-9e98-2035f8a4d091 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:34.863570 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5a540409-a989-42ce-9e98-2035f8a4d091 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:35.035493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-5a540409-a989-42ce-9e98-2035f8a4d091 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:35.045385 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-5a540409-a989-42ce-9e98-2035f8a4d091 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.201087 Sep 01 16:35:35.045385 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 124/271] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:34 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:35.078277 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f989483c-d737-42ac-a6ed-19967fdb0660 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:35.078917 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f989483c-d737-42ac-a6ed-19967fdb0660 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:35.081326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-df4a1526-878d-4736-b7c1-dd181b16d110 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:35.082537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-df4a1526-878d-4736-b7c1-dd181b16d110 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:35.090543 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:35.093977 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-df4a1526-878d-4736-b7c1-dd181b16d110 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:35.094482 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-df4a1526-878d-4736-b7c1-dd181b16d110 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:35.095238 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-df4a1526-878d-4736-b7c1-dd181b16d110 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:35.095421 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f989483c-d737-42ac-a6ed-19967fdb0660 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:35.096201 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f989483c-d737-42ac-a6ed-19967fdb0660 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:35.096714 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-df4a1526-878d-4736-b7c1-dd181b16d110 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:35.096828 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f989483c-d737-42ac-a6ed-19967fdb0660 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:35.097511 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-df4a1526-878d-4736-b7c1-dd181b16d110 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:35.097906 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f989483c-d737-42ac-a6ed-19967fdb0660 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:35.098448 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-df4a1526-878d-4736-b7c1-dd181b16d110 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:35.098878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f989483c-d737-42ac-a6ed-19967fdb0660 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:35.099418 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f989483c-d737-42ac-a6ed-19967fdb0660 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:35.127523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-f989483c-d737-42ac-a6ed-19967fdb0660 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] HTTP exception thrown: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f989483c-d737-42ac-a6ed-19967fdb0660 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Request method failure captured: Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: DELETE /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 HTTP/1.1 Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN78DQFgJI-F0Z5_R-fpp6Krezi3VA4ukMiYCbyzbOXqSu6hVah2BxBVlKt0M8P_CcU-JdK3SobvjmKeU3WJSnXMjqvG8tkcItsMfOcg3vGul-tzK_UVwmNepJVtAVYRa8iCY5xgMORtVLTBoBfaLt80DU48qmaCF-8167aMhuAzhG4 Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 5c40a340919a49cc8b73687df600e2ea Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-DeleteServersTestJSON-1059093282 Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:35:35.137673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:35:35.139878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c40a340919a49cc8b73687df600e2ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c40a340919a49cc8b73687df600e2ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c40a340919a49cc8b73687df600e2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c40a340919a49cc8b73687df600e2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:35:35.139878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-DeleteServersTestJSON-1059093282 Sep 01 16:35:35.139878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 5c40a340919a49cc8b73687df600e2ea Sep 01 16:35:35.139878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-DeleteServersTestJSON-1059093282 Sep 01 16:35:35.139878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-DeleteServersTestJSON-1059093282-project Sep 01 16:35:35.139878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:35:35.139878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:35:35.139878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: b172f56cbd604342ba6d8169c969e157 Sep 01 16:35:35.139878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-DeleteServersTestJSON-1059093282-project Sep 01 16:35:35.139878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:35:35.139878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:35.139878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': '6af33e17-eea1-4429-bca2-299dc3f02bf8'} Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:35:35.140873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:35.142167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:35.143934 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-df4a1526-878d-4736-b7c1-dd181b16d110 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:35.144410 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-df4a1526-878d-4736-b7c1-dd181b16d110 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:35.144836 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-df4a1526-878d-4736-b7c1-dd181b16d110 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:35.144954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f989483c-d737-42ac-a6ed-19967fdb0660 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Returning 404 to user: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:35:35.145288 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.objects.instance [None req-df4a1526-878d-4736-b7c1-dd181b16d110 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lazy-loading 'fault' on Instance uuid 9d892c9f-cd29-45a5-912a-292338f6f480 {{(pid=127178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:35:35.147234 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f989483c-d737-42ac-a6ed-19967fdb0660 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 404 len: 111 microversion: 2.1 time: 0.073924 Sep 01 16:35:35.149049 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 148/272] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:35:35 2022] DELETE /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:35:35.160066 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b37f364d-af37-444a-ba85-bc4c585d62f4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:35.165278 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b37f364d-af37-444a-ba85-bc4c585d62f4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] [instance: 6af33e17-eea1-4429-bca2-299dc3f02bf8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:35.169405 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b37f364d-af37-444a-ba85-bc4c585d62f4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:35.169961 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b37f364d-af37-444a-ba85-bc4c585d62f4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:35.170495 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b37f364d-af37-444a-ba85-bc4c585d62f4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:35.172842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b37f364d-af37-444a-ba85-bc4c585d62f4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:35.173384 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b37f364d-af37-444a-ba85-bc4c585d62f4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:35.173874 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b37f364d-af37-444a-ba85-bc4c585d62f4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:35.197604 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-b37f364d-af37-444a-ba85-bc4c585d62f4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] HTTP exception thrown: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b37f364d-af37-444a-ba85-bc4c585d62f4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Request method failure captured: Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 HTTP/1.1 Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN78DQFgJI-F0Z5_R-fpp6Krezi3VA4ukMiYCbyzbOXqSu6hVah2BxBVlKt0M8P_CcU-JdK3SobvjmKeU3WJSnXMjqvG8tkcItsMfOcg3vGul-tzK_UVwmNepJVtAVYRa8iCY5xgMORtVLTBoBfaLt80DU48qmaCF-8167aMhuAzhG4 Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 5c40a340919a49cc8b73687df600e2ea Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-DeleteServersTestJSON-1059093282 Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:35:35.199212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:35:35.200476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c40a340919a49cc8b73687df600e2ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c40a340919a49cc8b73687df600e2ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c40a340919a49cc8b73687df600e2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c40a340919a49cc8b73687df600e2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:35:35.200476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-DeleteServersTestJSON-1059093282 Sep 01 16:35:35.200476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 5c40a340919a49cc8b73687df600e2ea Sep 01 16:35:35.200476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-DeleteServersTestJSON-1059093282 Sep 01 16:35:35.200476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-DeleteServersTestJSON-1059093282-project Sep 01 16:35:35.200476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:35:35.200476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:35:35.200476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: b172f56cbd604342ba6d8169c969e157 Sep 01 16:35:35.200476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-DeleteServersTestJSON-1059093282-project Sep 01 16:35:35.200476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:35:35.200476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:35.200476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': '6af33e17-eea1-4429-bca2-299dc3f02bf8'} Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:35:35.201121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. Sep 01 16:35:35.202124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:35.203161 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b37f364d-af37-444a-ba85-bc4c585d62f4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] Returning 404 to user: Instance 6af33e17-eea1-4429-bca2-299dc3f02bf8 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:35:35.203161 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b37f364d-af37-444a-ba85-bc4c585d62f4 tempest-DeleteServersTestJSON-1059093282 tempest-DeleteServersTestJSON-1059093282-project] 10.222.0.18 "GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8" status: 404 len: 111 microversion: 2.1 time: 0.047328 Sep 01 16:35:35.203161 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 149/273] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:35 2022] GET /compute/v2.1/servers/6af33e17-eea1-4429-bca2-299dc3f02bf8 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:35:35.218502 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-df4a1526-878d-4736-b7c1-dd181b16d110 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:35.230830 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-df4a1526-878d-4736-b7c1-dd181b16d110 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 200 len: 1304 microversion: 2.1 time: 0.155290 Sep 01 16:35:35.231485 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 125/274] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:35 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 1304 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:36.073197 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-169bdb7a-ef6d-451b-8812-3eed609e988b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:36.073739 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-169bdb7a-ef6d-451b-8812-3eed609e988b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:36.081918 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-169bdb7a-ef6d-451b-8812-3eed609e988b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:36.082516 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-169bdb7a-ef6d-451b-8812-3eed609e988b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:36.083021 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-169bdb7a-ef6d-451b-8812-3eed609e988b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:36.083899 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-169bdb7a-ef6d-451b-8812-3eed609e988b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:36.084622 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-169bdb7a-ef6d-451b-8812-3eed609e988b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:36.085242 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-169bdb7a-ef6d-451b-8812-3eed609e988b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:36.254185 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ed6fe193-0bce-4a08-9629-848cd9e33ea8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:36.255072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ed6fe193-0bce-4a08-9629-848cd9e33ea8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: 9d892c9f-cd29-45a5-912a-292338f6f480] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:36.262158 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed6fe193-0bce-4a08-9629-848cd9e33ea8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:36.262929 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed6fe193-0bce-4a08-9629-848cd9e33ea8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:36.263582 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed6fe193-0bce-4a08-9629-848cd9e33ea8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:36.264361 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed6fe193-0bce-4a08-9629-848cd9e33ea8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:36.264881 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed6fe193-0bce-4a08-9629-848cd9e33ea8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:36.265486 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed6fe193-0bce-4a08-9629-848cd9e33ea8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:36.284759 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-ed6fe193-0bce-4a08-9629-848cd9e33ea8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] HTTP exception thrown: Instance 9d892c9f-cd29-45a5-912a-292338f6f480 could not be found. Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ed6fe193-0bce-4a08-9629-848cd9e33ea8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Request method failure captured: Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 HTTP/1.1 Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN8_EhkAop5m3tKr-dAKaHJkZ5XwRxQ3vj-yKmI3-ezg2MUCR2F3zfXPQqoQH0rQUlXKJmneyKYNZtaHMjptgJk3a2vobLekUl2rIOH5FoUHuQX8jPp6e724D88WzrLkFnR3m6A27UNDhryJhVh_3tlo4bKtf095QcGB4-FEpw8iJe4 Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: 0939af057f4940298089c8f89ec2865f Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-VolumesActionsTest-80650973 Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:35:36.287864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:35:36.289118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0939af057f4940298089c8f89ec2865f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0939af057f4940298089c8f89ec2865f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0939af057f4940298089c8f89ec2865f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0939af057f4940298089c8f89ec2865f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:35:36.289118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-VolumesActionsTest-80650973 Sep 01 16:35:36.289118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: 0939af057f4940298089c8f89ec2865f Sep 01 16:35:36.289118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-VolumesActionsTest-80650973 Sep 01 16:35:36.289118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-VolumesActionsTest-80650973-project Sep 01 16:35:36.289118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:35:36.289118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:35:36.289118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: 7425d9aefcf940709f3a3aad4166755c Sep 01 16:35:36.289118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-VolumesActionsTest-80650973-project Sep 01 16:35:36.289118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:35:36.289118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance 9d892c9f-cd29-45a5-912a-292338f6f480 could not be found. Sep 01 16:35:36.289118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': '9d892c9f-cd29-45a5-912a-292338f6f480'} Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d892c9f-cd29-45a5-912a-292338f6f480 could not be found. Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:35:36.290863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d892c9f-cd29-45a5-912a-292338f6f480 could not be found. Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d892c9f-cd29-45a5-912a-292338f6f480 could not be found. Sep 01 16:35:36.292381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:35:36.293417 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ed6fe193-0bce-4a08-9629-848cd9e33ea8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Returning 404 to user: Instance 9d892c9f-cd29-45a5-912a-292338f6f480 could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:35:36.293417 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ed6fe193-0bce-4a08-9629-848cd9e33ea8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480" status: 404 len: 111 microversion: 2.1 time: 0.040331 Sep 01 16:35:36.293417 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 126/275] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:36 2022] GET /compute/v2.1/servers/9d892c9f-cd29-45a5-912a-292338f6f480 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:35:36.313323 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-169bdb7a-ef6d-451b-8812-3eed609e988b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:36.328917 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-169bdb7a-ef6d-451b-8812-3eed609e988b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.259447 Sep 01 16:35:36.342498 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 150/276] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:36 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:36.452618 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-521303184", "imageRef": "46185d58-0d47-4c97-b590-0f4434aa5c9e", "flavorRef": "452", "networks": [{"uuid": "d5d66e81-f1e9-4144-8569-14dac1ce6e4e"}]}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:36.511702 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.network.neutron [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] validate_networks() for [('d5d66e81-f1e9-4144-8569-14dac1ce6e4e', None, None, None, None, None)] {{(pid=127178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:35:36.972356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Flavor limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:35:36.973303 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Image limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:35:36.974099 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Flavor pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:35:36.974676 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Image pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:35:36.975655 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:35:36.984867 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:36.985587 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:36.986303 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:36.987417 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:36.987872 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:36.988293 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:37.006678 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Getting quotas for project 0939af057f4940298089c8f89ec2865f. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:35:37.011652 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Getting quotas for user 7425d9aefcf940709f3a3aad4166755c and project 0939af057f4940298089c8f89ec2865f. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:35:37.026261 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Going to run 1 instances... {{(pid=127178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:35:37.028637 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46185d58-0d47-4c97-b590-0f4434aa5c9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:35:37.093112 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b09c05e9-d7fa-47a4-a51f-a13b5b32923d tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644155 Sep 01 16:35:37.093823 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 127/277] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:35:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:35:37.111351 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b021b9dd-75c9-41a7-b449-8b48928a89c7 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:37.112571 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b021b9dd-75c9-41a7-b449-8b48928a89c7 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:37.179798 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b021b9dd-75c9-41a7-b449-8b48928a89c7 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:37.199721 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b021b9dd-75c9-41a7-b449-8b48928a89c7 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 200 len: 1213 microversion: 2.1 time: 0.099048 Sep 01 16:35:37.200472 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 151/278] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:37 2022] GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:37.351725 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-eb1e6a86-15a0-4aa5-8a91-31f4ddfbf07e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:37.352438 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-eb1e6a86-15a0-4aa5-8a91-31f4ddfbf07e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:37.386217 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eb1e6a86-15a0-4aa5-8a91-31f4ddfbf07e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:37.387773 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eb1e6a86-15a0-4aa5-8a91-31f4ddfbf07e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:37.388405 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eb1e6a86-15a0-4aa5-8a91-31f4ddfbf07e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:37.404011 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eb1e6a86-15a0-4aa5-8a91-31f4ddfbf07e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:37.404511 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eb1e6a86-15a0-4aa5-8a91-31f4ddfbf07e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:37.407907 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eb1e6a86-15a0-4aa5-8a91-31f4ddfbf07e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:37.657636 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-eb1e6a86-15a0-4aa5-8a91-31f4ddfbf07e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:37.666829 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-eb1e6a86-15a0-4aa5-8a91-31f4ddfbf07e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.318993 Sep 01 16:35:37.682079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 128/279] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:37 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:38.222393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7f1db309-7b04-4009-8008-b3ea2cf1e8af tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:38.222908 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7f1db309-7b04-4009-8008-b3ea2cf1e8af tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:38.229719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f1db309-7b04-4009-8008-b3ea2cf1e8af tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:38.230187 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f1db309-7b04-4009-8008-b3ea2cf1e8af tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:38.230635 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f1db309-7b04-4009-8008-b3ea2cf1e8af tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:38.231304 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f1db309-7b04-4009-8008-b3ea2cf1e8af tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:38.231745 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f1db309-7b04-4009-8008-b3ea2cf1e8af tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:38.232151 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f1db309-7b04-4009-8008-b3ea2cf1e8af tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:38.364012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7f1db309-7b04-4009-8008-b3ea2cf1e8af tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:38.372786 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7f1db309-7b04-4009-8008-b3ea2cf1e8af tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 200 len: 1217 microversion: 2.1 time: 0.155978 Sep 01 16:35:38.373204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 152/280] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:38 2022] GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:38.688524 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d246c267-629b-4a0d-bea4-02be5b3e49ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:38.689055 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d246c267-629b-4a0d-bea4-02be5b3e49ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:38.702177 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d246c267-629b-4a0d-bea4-02be5b3e49ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:38.707666 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d246c267-629b-4a0d-bea4-02be5b3e49ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:38.708339 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d246c267-629b-4a0d-bea4-02be5b3e49ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:38.709271 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d246c267-629b-4a0d-bea4-02be5b3e49ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:38.709905 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d246c267-629b-4a0d-bea4-02be5b3e49ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:38.710548 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d246c267-629b-4a0d-bea4-02be5b3e49ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:38.753015 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:38.935036 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d246c267-629b-4a0d-bea4-02be5b3e49ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:38.952732 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d246c267-629b-4a0d-bea4-02be5b3e49ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.269420 Sep 01 16:35:38.953315 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 129/281] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:38 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:39.394395 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d0816b7d-98a4-41b0-9d3f-1d159275d027 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:39.395732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d0816b7d-98a4-41b0-9d3f-1d159275d027 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:39.403330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0816b7d-98a4-41b0-9d3f-1d159275d027 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:39.404455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0816b7d-98a4-41b0-9d3f-1d159275d027 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:39.405111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0816b7d-98a4-41b0-9d3f-1d159275d027 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:39.406338 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0816b7d-98a4-41b0-9d3f-1d159275d027 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:39.407825 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0816b7d-98a4-41b0-9d3f-1d159275d027 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:39.408497 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0816b7d-98a4-41b0-9d3f-1d159275d027 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:39.440476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:39.507945 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d0816b7d-98a4-41b0-9d3f-1d159275d027 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:39.537530 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d0816b7d-98a4-41b0-9d3f-1d159275d027 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 200 len: 1273 microversion: 2.1 time: 0.146130 Sep 01 16:35:39.538150 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 153/282] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:39 2022] GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 1273 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:39.974575 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-fc22b54a-2389-4e70-80ec-da1a6bc6c1b0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:39.975206 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-fc22b54a-2389-4e70-80ec-da1a6bc6c1b0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:39.984838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fc22b54a-2389-4e70-80ec-da1a6bc6c1b0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:39.985327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fc22b54a-2389-4e70-80ec-da1a6bc6c1b0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:39.985784 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fc22b54a-2389-4e70-80ec-da1a6bc6c1b0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:39.986509 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fc22b54a-2389-4e70-80ec-da1a6bc6c1b0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:39.986990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fc22b54a-2389-4e70-80ec-da1a6bc6c1b0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:39.987418 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fc22b54a-2389-4e70-80ec-da1a6bc6c1b0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:40.284487 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-fc22b54a-2389-4e70-80ec-da1a6bc6c1b0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:40.302070 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-fc22b54a-2389-4e70-80ec-da1a6bc6c1b0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.331332 Sep 01 16:35:40.306432 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 130/283] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:39 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:40.564014 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2ea05a16-b6ba-4791-a220-7c28a3075b47 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:40.564630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2ea05a16-b6ba-4791-a220-7c28a3075b47 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:40.571295 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ea05a16-b6ba-4791-a220-7c28a3075b47 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:40.571772 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ea05a16-b6ba-4791-a220-7c28a3075b47 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:40.572213 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ea05a16-b6ba-4791-a220-7c28a3075b47 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:40.572920 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ea05a16-b6ba-4791-a220-7c28a3075b47 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:40.573400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ea05a16-b6ba-4791-a220-7c28a3075b47 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:40.573815 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ea05a16-b6ba-4791-a220-7c28a3075b47 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:40.748917 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2ea05a16-b6ba-4791-a220-7c28a3075b47 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:40.761651 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2ea05a16-b6ba-4791-a220-7c28a3075b47 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 200 len: 1313 microversion: 2.1 time: 0.206257 Sep 01 16:35:40.763076 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 154/284] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:40 2022] GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:41.162506 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-9f317168-f96e-4498-959f-07527c056e91 req-df5cb3fd-8d75-40df-9b41-4b517b2f9515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8caa499-489e-4644-b31a-8dc893a00b66", "tag": "275b2cb4-f60a-4816-9fa2-89adf7eeb4a0"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:41.182150 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-9f317168-f96e-4498-959f-07527c056e91 req-df5cb3fd-8d75-40df-9b41-4b517b2f9515 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:41.186006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-9f317168-f96e-4498-959f-07527c056e91 req-df5cb3fd-8d75-40df-9b41-4b517b2f9515 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:41.188352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-9f317168-f96e-4498-959f-07527c056e91 req-df5cb3fd-8d75-40df-9b41-4b517b2f9515 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:41.200882 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-9f317168-f96e-4498-959f-07527c056e91 req-df5cb3fd-8d75-40df-9b41-4b517b2f9515 service nova] Creating event network-changed:275b2cb4-f60a-4816-9fa2-89adf7eeb4a0 for instance b8caa499-489e-4644-b31a-8dc893a00b66 on hv-cinder-85220 Sep 01 16:35:41.206503 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-9f317168-f96e-4498-959f-07527c056e91 req-df5cb3fd-8d75-40df-9b41-4b517b2f9515 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047464 Sep 01 16:35:41.216406 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 131/285] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:35:41.329545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-021bea27-987a-4ed7-94f4-200f870feaeb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:41.330154 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-021bea27-987a-4ed7-94f4-200f870feaeb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:41.336079 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-021bea27-987a-4ed7-94f4-200f870feaeb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:41.337051 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-021bea27-987a-4ed7-94f4-200f870feaeb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:41.337481 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-021bea27-987a-4ed7-94f4-200f870feaeb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:41.338161 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-021bea27-987a-4ed7-94f4-200f870feaeb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:41.338638 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-021bea27-987a-4ed7-94f4-200f870feaeb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:41.339054 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-021bea27-987a-4ed7-94f4-200f870feaeb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:41.496685 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-021bea27-987a-4ed7-94f4-200f870feaeb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:41.505028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-021bea27-987a-4ed7-94f4-200f870feaeb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.179218 Sep 01 16:35:41.505631 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 155/286] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:41 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:41.788713 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a2ddb6c1-c479-49c1-bc03-9a0b11a24bbe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:41.790072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a2ddb6c1-c479-49c1-bc03-9a0b11a24bbe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:41.818481 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a2ddb6c1-c479-49c1-bc03-9a0b11a24bbe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:41.818481 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a2ddb6c1-c479-49c1-bc03-9a0b11a24bbe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:41.818481 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a2ddb6c1-c479-49c1-bc03-9a0b11a24bbe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:41.818481 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a2ddb6c1-c479-49c1-bc03-9a0b11a24bbe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:41.819007 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a2ddb6c1-c479-49c1-bc03-9a0b11a24bbe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:41.819007 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a2ddb6c1-c479-49c1-bc03-9a0b11a24bbe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:41.953229 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a2ddb6c1-c479-49c1-bc03-9a0b11a24bbe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:41.960818 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a2ddb6c1-c479-49c1-bc03-9a0b11a24bbe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 200 len: 1313 microversion: 2.1 time: 0.176477 Sep 01 16:35:41.961412 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 132/287] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:41 2022] GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:42.526954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b2631eb7-897b-441e-8bc9-5d08aad15415 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:42.527557 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b2631eb7-897b-441e-8bc9-5d08aad15415 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:42.534166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b2631eb7-897b-441e-8bc9-5d08aad15415 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:42.534657 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b2631eb7-897b-441e-8bc9-5d08aad15415 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:42.535251 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b2631eb7-897b-441e-8bc9-5d08aad15415 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:42.535941 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b2631eb7-897b-441e-8bc9-5d08aad15415 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:42.536410 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b2631eb7-897b-441e-8bc9-5d08aad15415 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:42.536984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b2631eb7-897b-441e-8bc9-5d08aad15415 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:42.682105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b2631eb7-897b-441e-8bc9-5d08aad15415 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:42.690133 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b2631eb7-897b-441e-8bc9-5d08aad15415 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.167747 Sep 01 16:35:42.690883 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 156/288] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:42 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:42.981291 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f1d092e8-90fb-415a-9d01-1f9cf6749090 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:42.982045 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f1d092e8-90fb-415a-9d01-1f9cf6749090 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:42.988847 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f1d092e8-90fb-415a-9d01-1f9cf6749090 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:42.989487 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f1d092e8-90fb-415a-9d01-1f9cf6749090 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:42.989904 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f1d092e8-90fb-415a-9d01-1f9cf6749090 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:42.990619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f1d092e8-90fb-415a-9d01-1f9cf6749090 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:42.991068 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f1d092e8-90fb-415a-9d01-1f9cf6749090 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:42.991484 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f1d092e8-90fb-415a-9d01-1f9cf6749090 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:43.138685 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f1d092e8-90fb-415a-9d01-1f9cf6749090 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:43.146677 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f1d092e8-90fb-415a-9d01-1f9cf6749090 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 200 len: 1313 microversion: 2.1 time: 0.169531 Sep 01 16:35:43.147242 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 133/289] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:42 2022] GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:43.711684 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-52ddd719-f7bb-4b43-8d53-b75e130f3e53 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:43.712200 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-52ddd719-f7bb-4b43-8d53-b75e130f3e53 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:43.718692 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52ddd719-f7bb-4b43-8d53-b75e130f3e53 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:43.719622 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52ddd719-f7bb-4b43-8d53-b75e130f3e53 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:43.720422 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52ddd719-f7bb-4b43-8d53-b75e130f3e53 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:43.721374 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52ddd719-f7bb-4b43-8d53-b75e130f3e53 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:43.721830 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52ddd719-f7bb-4b43-8d53-b75e130f3e53 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:43.722479 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52ddd719-f7bb-4b43-8d53-b75e130f3e53 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:43.887695 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-52ddd719-f7bb-4b43-8d53-b75e130f3e53 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:43.897607 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-52ddd719-f7bb-4b43-8d53-b75e130f3e53 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.190006 Sep 01 16:35:43.902859 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 157/290] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:43 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:44.168712 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ea08e79f-f807-4d36-b2f3-ab9d5ebe9942 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:44.169970 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ea08e79f-f807-4d36-b2f3-ab9d5ebe9942 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:44.176347 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ea08e79f-f807-4d36-b2f3-ab9d5ebe9942 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:44.176834 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ea08e79f-f807-4d36-b2f3-ab9d5ebe9942 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:44.177269 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ea08e79f-f807-4d36-b2f3-ab9d5ebe9942 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:44.177964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ea08e79f-f807-4d36-b2f3-ab9d5ebe9942 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:44.178443 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ea08e79f-f807-4d36-b2f3-ab9d5ebe9942 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:44.179026 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ea08e79f-f807-4d36-b2f3-ab9d5ebe9942 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:44.321291 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ea08e79f-f807-4d36-b2f3-ab9d5ebe9942 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:44.329792 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ea08e79f-f807-4d36-b2f3-ab9d5ebe9942 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 200 len: 1313 microversion: 2.1 time: 0.166264 Sep 01 16:35:44.330456 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 134/291] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:44 2022] GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:44.924646 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c5481e4c-2485-4728-9756-6653ed0f7722 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:44.925261 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c5481e4c-2485-4728-9756-6653ed0f7722 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:44.931812 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5481e4c-2485-4728-9756-6653ed0f7722 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:44.932331 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5481e4c-2485-4728-9756-6653ed0f7722 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:44.932719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5481e4c-2485-4728-9756-6653ed0f7722 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:44.934149 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5481e4c-2485-4728-9756-6653ed0f7722 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:44.934867 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5481e4c-2485-4728-9756-6653ed0f7722 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:44.935298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5481e4c-2485-4728-9756-6653ed0f7722 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:45.103443 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c5481e4c-2485-4728-9756-6653ed0f7722 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:45.112836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c5481e4c-2485-4728-9756-6653ed0f7722 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.192267 Sep 01 16:35:45.113889 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 158/292] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:44 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:45.352805 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-91d590f0-d3c9-4638-9175-8fac10050bfe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:45.354425 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-91d590f0-d3c9-4638-9175-8fac10050bfe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:45.361048 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-91d590f0-d3c9-4638-9175-8fac10050bfe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:45.361948 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-91d590f0-d3c9-4638-9175-8fac10050bfe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:45.362612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-91d590f0-d3c9-4638-9175-8fac10050bfe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:45.363808 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-91d590f0-d3c9-4638-9175-8fac10050bfe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:45.364461 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-91d590f0-d3c9-4638-9175-8fac10050bfe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:45.365087 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-91d590f0-d3c9-4638-9175-8fac10050bfe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:45.750865 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-91d590f0-d3c9-4638-9175-8fac10050bfe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:45.767946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-91d590f0-d3c9-4638-9175-8fac10050bfe tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 200 len: 1313 microversion: 2.1 time: 0.418834 Sep 01 16:35:45.771739 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 135/293] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:45 2022] GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:46.135096 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-686c05b9-2343-4e53-ab79-24e58494394a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:46.135691 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-686c05b9-2343-4e53-ab79-24e58494394a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:46.143003 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-686c05b9-2343-4e53-ab79-24e58494394a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:46.143660 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-686c05b9-2343-4e53-ab79-24e58494394a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:46.144083 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-686c05b9-2343-4e53-ab79-24e58494394a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:46.144767 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-686c05b9-2343-4e53-ab79-24e58494394a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:46.145421 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-686c05b9-2343-4e53-ab79-24e58494394a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:46.145984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-686c05b9-2343-4e53-ab79-24e58494394a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:46.293968 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-686c05b9-2343-4e53-ab79-24e58494394a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:46.301992 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-686c05b9-2343-4e53-ab79-24e58494394a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.170819 Sep 01 16:35:46.302608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 159/294] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:46 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:46.793550 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b879661a-c9ba-496f-a3c2-6b743a81eb48 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:46.794909 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b879661a-c9ba-496f-a3c2-6b743a81eb48 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:46.808188 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b879661a-c9ba-496f-a3c2-6b743a81eb48 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:46.808820 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b879661a-c9ba-496f-a3c2-6b743a81eb48 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:46.809216 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b879661a-c9ba-496f-a3c2-6b743a81eb48 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:46.809956 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b879661a-c9ba-496f-a3c2-6b743a81eb48 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:46.813277 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b879661a-c9ba-496f-a3c2-6b743a81eb48 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:46.813901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b879661a-c9ba-496f-a3c2-6b743a81eb48 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:46.997405 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:47.018582 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=6 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:47.242856 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b879661a-c9ba-496f-a3c2-6b743a81eb48 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:47.259445 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b879661a-c9ba-496f-a3c2-6b743a81eb48 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 200 len: 1313 microversion: 2.1 time: 0.470199 Sep 01 16:35:47.260224 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 136/295] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:46 2022] GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:47.324088 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-43ade1cd-b471-44a9-afaa-c41f5e066bdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:47.325299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-43ade1cd-b471-44a9-afaa-c41f5e066bdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:47.328583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:47.341213 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43ade1cd-b471-44a9-afaa-c41f5e066bdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:47.342750 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43ade1cd-b471-44a9-afaa-c41f5e066bdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:47.344413 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43ade1cd-b471-44a9-afaa-c41f5e066bdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:47.346278 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43ade1cd-b471-44a9-afaa-c41f5e066bdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:47.346854 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43ade1cd-b471-44a9-afaa-c41f5e066bdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:47.348524 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43ade1cd-b471-44a9-afaa-c41f5e066bdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:47.576829 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-43ade1cd-b471-44a9-afaa-c41f5e066bdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:47.586623 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-43ade1cd-b471-44a9-afaa-c41f5e066bdb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.267743 Sep 01 16:35:47.587910 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 160/296] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:47 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:48.284266 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-58741f45-58a3-460c-a64e-a5f793960848 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:48.285559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-58741f45-58a3-460c-a64e-a5f793960848 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:48.292668 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-58741f45-58a3-460c-a64e-a5f793960848 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:48.293163 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-58741f45-58a3-460c-a64e-a5f793960848 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:48.293591 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-58741f45-58a3-460c-a64e-a5f793960848 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:48.294428 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-58741f45-58a3-460c-a64e-a5f793960848 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:48.294920 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-58741f45-58a3-460c-a64e-a5f793960848 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:48.295501 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-58741f45-58a3-460c-a64e-a5f793960848 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:48.455331 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-58741f45-58a3-460c-a64e-a5f793960848 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:48.465263 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-58741f45-58a3-460c-a64e-a5f793960848 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 200 len: 1313 microversion: 2.1 time: 0.184808 Sep 01 16:35:48.466079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 137/297] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:48 2022] GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:48.552053 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-e35cef00-59f9-4956-9fd4-f1881b5effe6 req-225d8923-dad4-42de-9731-d687d40f69e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8caa499-489e-4644-b31a-8dc893a00b66", "name": "network-vif-plugged", "status": "completed", "tag": "275b2cb4-f60a-4816-9fa2-89adf7eeb4a0"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:48.590681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e35cef00-59f9-4956-9fd4-f1881b5effe6 req-225d8923-dad4-42de-9731-d687d40f69e3 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:48.610067 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e35cef00-59f9-4956-9fd4-f1881b5effe6 req-225d8923-dad4-42de-9731-d687d40f69e3 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:48.610067 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e35cef00-59f9-4956-9fd4-f1881b5effe6 req-225d8923-dad4-42de-9731-d687d40f69e3 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:48.611341 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f5f87f84-8077-4cc9-8a5b-92f86e6d610c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:48.611341 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f5f87f84-8077-4cc9-8a5b-92f86e6d610c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:48.619405 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f5f87f84-8077-4cc9-8a5b-92f86e6d610c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:48.621115 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f5f87f84-8077-4cc9-8a5b-92f86e6d610c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:48.622253 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-e35cef00-59f9-4956-9fd4-f1881b5effe6 req-225d8923-dad4-42de-9731-d687d40f69e3 service nova] Creating event network-vif-plugged:275b2cb4-f60a-4816-9fa2-89adf7eeb4a0 for instance b8caa499-489e-4644-b31a-8dc893a00b66 on hv-cinder-85220 Sep 01 16:35:48.623010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f5f87f84-8077-4cc9-8a5b-92f86e6d610c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:48.624116 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f5f87f84-8077-4cc9-8a5b-92f86e6d610c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:48.625005 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f5f87f84-8077-4cc9-8a5b-92f86e6d610c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:48.627427 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f5f87f84-8077-4cc9-8a5b-92f86e6d610c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:48.627563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-e35cef00-59f9-4956-9fd4-f1881b5effe6 req-225d8923-dad4-42de-9731-d687d40f69e3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080827 Sep 01 16:35:48.628457 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 161/298] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:35:48.792326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f5f87f84-8077-4cc9-8a5b-92f86e6d610c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:48.801137 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f5f87f84-8077-4cc9-8a5b-92f86e6d610c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1520 microversion: 2.1 time: 0.195938 Sep 01 16:35:48.801735 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 138/299] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:48 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:49.488570 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-75f47539-ba81-4478-a6ef-15d786a63f05 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:49.489590 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-75f47539-ba81-4478-a6ef-15d786a63f05 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:49.497018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-75f47539-ba81-4478-a6ef-15d786a63f05 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:49.497503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-75f47539-ba81-4478-a6ef-15d786a63f05 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:49.497930 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-75f47539-ba81-4478-a6ef-15d786a63f05 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:49.498722 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-75f47539-ba81-4478-a6ef-15d786a63f05 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:49.499172 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-75f47539-ba81-4478-a6ef-15d786a63f05 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:49.499619 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-75f47539-ba81-4478-a6ef-15d786a63f05 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:49.638041 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-75f47539-ba81-4478-a6ef-15d786a63f05 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:49.647078 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-75f47539-ba81-4478-a6ef-15d786a63f05 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 200 len: 1313 microversion: 2.1 time: 0.162833 Sep 01 16:35:49.647683 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 162/300] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:49 2022] GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:49.823115 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c83b5459-3f1f-4897-baf6-3e647e0eee62 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:49.823686 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c83b5459-3f1f-4897-baf6-3e647e0eee62 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:49.830655 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c83b5459-3f1f-4897-baf6-3e647e0eee62 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:49.831140 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c83b5459-3f1f-4897-baf6-3e647e0eee62 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:49.831688 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c83b5459-3f1f-4897-baf6-3e647e0eee62 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:49.832469 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c83b5459-3f1f-4897-baf6-3e647e0eee62 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:49.832940 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c83b5459-3f1f-4897-baf6-3e647e0eee62 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:49.833349 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c83b5459-3f1f-4897-baf6-3e647e0eee62 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:49.975009 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c83b5459-3f1f-4897-baf6-3e647e0eee62 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:49.983351 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c83b5459-3f1f-4897-baf6-3e647e0eee62 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1500 microversion: 2.1 time: 0.164053 Sep 01 16:35:49.984120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 139/301] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:49 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1500 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:50.002654 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b79dc1cd-95e0-4fb8-afd6-9d310eae7774 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:50.003255 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b79dc1cd-95e0-4fb8-afd6-9d310eae7774 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:50.009792 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b79dc1cd-95e0-4fb8-afd6-9d310eae7774 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:50.010286 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b79dc1cd-95e0-4fb8-afd6-9d310eae7774 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:50.010712 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b79dc1cd-95e0-4fb8-afd6-9d310eae7774 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:50.011396 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b79dc1cd-95e0-4fb8-afd6-9d310eae7774 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:50.011836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b79dc1cd-95e0-4fb8-afd6-9d310eae7774 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:50.012246 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b79dc1cd-95e0-4fb8-afd6-9d310eae7774 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:50.155862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b79dc1cd-95e0-4fb8-afd6-9d310eae7774 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:50.164465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b79dc1cd-95e0-4fb8-afd6-9d310eae7774 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1513 microversion: 2.1 time: 0.165455 Sep 01 16:35:50.165258 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 163/302] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:49 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:50.669499 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-4fd60420-8564-43c7-8ac6-6531e99b285b tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:50.670180 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-4fd60420-8564-43c7-8ac6-6531e99b285b tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:50.682584 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4fd60420-8564-43c7-8ac6-6531e99b285b tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:50.684180 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4fd60420-8564-43c7-8ac6-6531e99b285b tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:50.684883 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4fd60420-8564-43c7-8ac6-6531e99b285b tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:50.685585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4fd60420-8564-43c7-8ac6-6531e99b285b tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:50.686034 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4fd60420-8564-43c7-8ac6-6531e99b285b tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:50.686615 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4fd60420-8564-43c7-8ac6-6531e99b285b tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:50.836252 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-4fd60420-8564-43c7-8ac6-6531e99b285b tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:50.844073 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-4fd60420-8564-43c7-8ac6-6531e99b285b tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 200 len: 1313 microversion: 2.1 time: 0.178604 Sep 01 16:35:50.844638 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 140/303] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:50 2022] GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:51.603029 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7178544d-5af2-49e5-b982-95c07d668149 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:51.607035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7178544d-5af2-49e5-b982-95c07d668149 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:51.614768 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7178544d-5af2-49e5-b982-95c07d668149 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:51.616676 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7178544d-5af2-49e5-b982-95c07d668149 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:51.617320 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7178544d-5af2-49e5-b982-95c07d668149 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:51.618261 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7178544d-5af2-49e5-b982-95c07d668149 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:51.619138 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7178544d-5af2-49e5-b982-95c07d668149 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:51.619880 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7178544d-5af2-49e5-b982-95c07d668149 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:51.660635 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-7178544d-5af2-49e5-b982-95c07d668149 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lazy-loading 'flavor' on Instance uuid 13e447e7-8805-447e-8cf9-7771733bf00f {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:35:51.764955 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7178544d-5af2-49e5-b982-95c07d668149 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "POST /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f/action" status: 200 len: 32 microversion: 2.1 time: 0.165957 Sep 01 16:35:51.767059 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 164/304] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 1 16:35:51 2022] POST /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 16:35:51.779593 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-5e981772-3b29-4472-874c-aa749aa8658d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:51.780217 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-5e981772-3b29-4472-874c-aa749aa8658d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:51.802063 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5e981772-3b29-4472-874c-aa749aa8658d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:51.802805 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5e981772-3b29-4472-874c-aa749aa8658d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:51.803666 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5e981772-3b29-4472-874c-aa749aa8658d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:51.807040 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5e981772-3b29-4472-874c-aa749aa8658d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:51.807776 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5e981772-3b29-4472-874c-aa749aa8658d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:51.808447 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5e981772-3b29-4472-874c-aa749aa8658d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:51.868120 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6a284839-901f-40ac-a087-c674f57b0f16 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:51.868815 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6a284839-901f-40ac-a087-c674f57b0f16 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:51.886668 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6a284839-901f-40ac-a087-c674f57b0f16 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:51.887170 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6a284839-901f-40ac-a087-c674f57b0f16 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:51.887729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6a284839-901f-40ac-a087-c674f57b0f16 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:51.888448 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6a284839-901f-40ac-a087-c674f57b0f16 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:51.888901 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6a284839-901f-40ac-a087-c674f57b0f16 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:51.889320 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6a284839-901f-40ac-a087-c674f57b0f16 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:52.077391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-5e981772-3b29-4472-874c-aa749aa8658d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:52.088487 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-5e981772-3b29-4472-874c-aa749aa8658d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.314629 Sep 01 16:35:52.089866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 141/305] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:51 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:52.144500 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6a284839-901f-40ac-a087-c674f57b0f16 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:52.155241 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6a284839-901f-40ac-a087-c674f57b0f16 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 200 len: 1497 microversion: 2.1 time: 0.293648 Sep 01 16:35:52.156422 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 165/306] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:51 2022] GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 1497 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:53.042771 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-923fcad6-3fb1-419e-bdaa-7d87a99b8d6a tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:53.043205 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-923fcad6-3fb1-419e-bdaa-7d87a99b8d6a tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:53.049673 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-923fcad6-3fb1-419e-bdaa-7d87a99b8d6a tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:53.050509 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-923fcad6-3fb1-419e-bdaa-7d87a99b8d6a tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:53.051167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-923fcad6-3fb1-419e-bdaa-7d87a99b8d6a tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:53.051866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-923fcad6-3fb1-419e-bdaa-7d87a99b8d6a tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:53.052321 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-923fcad6-3fb1-419e-bdaa-7d87a99b8d6a tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:53.053150 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-923fcad6-3fb1-419e-bdaa-7d87a99b8d6a tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:53.079937 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-923fcad6-3fb1-419e-bdaa-7d87a99b8d6a tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Going to try to terminate instance {{(pid=127178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:35:53.112124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f8fbbbf2-71ec-46a9-88c0-885d8902f007 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:53.112836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f8fbbbf2-71ec-46a9-88c0-885d8902f007 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:53.123968 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f8fbbbf2-71ec-46a9-88c0-885d8902f007 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:53.136915 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f8fbbbf2-71ec-46a9-88c0-885d8902f007 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:53.137353 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f8fbbbf2-71ec-46a9-88c0-885d8902f007 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:53.138138 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f8fbbbf2-71ec-46a9-88c0-885d8902f007 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:53.139553 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f8fbbbf2-71ec-46a9-88c0-885d8902f007 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:53.139968 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f8fbbbf2-71ec-46a9-88c0-885d8902f007 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:53.223775 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-923fcad6-3fb1-419e-bdaa-7d87a99b8d6a tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 204 len: 0 microversion: 2.1 time: 0.179768 Sep 01 16:35:53.225309 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 142/307] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:35:53 2022] DELETE /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:35:53.236127 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c0e3b6c7-a376-49d5-85e6-671ce2d56a88 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:53.237262 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c0e3b6c7-a376-49d5-85e6-671ce2d56a88 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:53.244582 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c0e3b6c7-a376-49d5-85e6-671ce2d56a88 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:53.245498 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c0e3b6c7-a376-49d5-85e6-671ce2d56a88 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:53.246622 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c0e3b6c7-a376-49d5-85e6-671ce2d56a88 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:53.247573 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c0e3b6c7-a376-49d5-85e6-671ce2d56a88 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:53.248261 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c0e3b6c7-a376-49d5-85e6-671ce2d56a88 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:53.249016 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c0e3b6c7-a376-49d5-85e6-671ce2d56a88 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:53.445197 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f8fbbbf2-71ec-46a9-88c0-885d8902f007 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:53.455952 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f8fbbbf2-71ec-46a9-88c0-885d8902f007 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.348775 Sep 01 16:35:53.456840 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 166/308] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:53 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:53.520135 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c0e3b6c7-a376-49d5-85e6-671ce2d56a88 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:53.534209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c0e3b6c7-a376-49d5-85e6-671ce2d56a88 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 200 len: 1503 microversion: 2.1 time: 0.302869 Sep 01 16:35:53.534879 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 143/309] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:53 2022] GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 1503 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:54.478008 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4633abaf-016c-45f2-a903-e4c01a314ae6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:54.479603 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4633abaf-016c-45f2-a903-e4c01a314ae6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:54.486146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4633abaf-016c-45f2-a903-e4c01a314ae6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:54.486790 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4633abaf-016c-45f2-a903-e4c01a314ae6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:54.487390 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4633abaf-016c-45f2-a903-e4c01a314ae6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:54.488432 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4633abaf-016c-45f2-a903-e4c01a314ae6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:54.488873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4633abaf-016c-45f2-a903-e4c01a314ae6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:54.489582 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4633abaf-016c-45f2-a903-e4c01a314ae6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:54.556789 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-0db67c09-f18a-4d0b-8844-18153183ba8e tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:54.557783 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0db67c09-f18a-4d0b-8844-18153183ba8e tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:54.565903 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0db67c09-f18a-4d0b-8844-18153183ba8e tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:54.566738 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0db67c09-f18a-4d0b-8844-18153183ba8e tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:54.567285 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0db67c09-f18a-4d0b-8844-18153183ba8e tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:54.568194 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0db67c09-f18a-4d0b-8844-18153183ba8e tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:54.568840 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0db67c09-f18a-4d0b-8844-18153183ba8e tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:54.569462 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0db67c09-f18a-4d0b-8844-18153183ba8e tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:54.697179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4633abaf-016c-45f2-a903-e4c01a314ae6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:54.709729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4633abaf-016c-45f2-a903-e4c01a314ae6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.235899 Sep 01 16:35:54.711985 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 167/310] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:54 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:54.725549 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0db67c09-f18a-4d0b-8844-18153183ba8e tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:54.735870 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-0db67c09-f18a-4d0b-8844-18153183ba8e tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 200 len: 1503 microversion: 2.1 time: 0.184184 Sep 01 16:35:54.736449 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 144/311] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:54 2022] GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:55.698528 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-26f9c1c2-e7e4-41a7-895b-ecad3922c591 req-cb36fc50-b72b-49eb-9780-9c06c3a87425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8caa499-489e-4644-b31a-8dc893a00b66", "name": "network-vif-deleted", "tag": "275b2cb4-f60a-4816-9fa2-89adf7eeb4a0"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:55.712946 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-26f9c1c2-e7e4-41a7-895b-ecad3922c591 req-cb36fc50-b72b-49eb-9780-9c06c3a87425 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:55.714086 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-26f9c1c2-e7e4-41a7-895b-ecad3922c591 req-cb36fc50-b72b-49eb-9780-9c06c3a87425 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:55.715083 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-26f9c1c2-e7e4-41a7-895b-ecad3922c591 req-cb36fc50-b72b-49eb-9780-9c06c3a87425 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:55.734620 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-9e434d36-c898-4cf2-92ea-11b8d62e94dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:55.736443 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-9e434d36-c898-4cf2-92ea-11b8d62e94dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:55.743209 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-26f9c1c2-e7e4-41a7-895b-ecad3922c591 req-cb36fc50-b72b-49eb-9780-9c06c3a87425 service nova] Creating event network-vif-deleted:275b2cb4-f60a-4816-9fa2-89adf7eeb4a0 for instance b8caa499-489e-4644-b31a-8dc893a00b66 on hv-cinder-85220 Sep 01 16:35:55.747987 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9e434d36-c898-4cf2-92ea-11b8d62e94dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:55.749415 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9e434d36-c898-4cf2-92ea-11b8d62e94dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:55.750518 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9e434d36-c898-4cf2-92ea-11b8d62e94dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:55.751670 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-26f9c1c2-e7e4-41a7-895b-ecad3922c591 req-cb36fc50-b72b-49eb-9780-9c06c3a87425 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065187 Sep 01 16:35:55.752367 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9e434d36-c898-4cf2-92ea-11b8d62e94dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:55.753080 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 168/312] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:35:55.753478 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9e434d36-c898-4cf2-92ea-11b8d62e94dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:55.753996 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9e434d36-c898-4cf2-92ea-11b8d62e94dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:55.761876 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:55.773554 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4fb957a6-6861-44de-92d8-3abd18c7d2c8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:55.775101 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4fb957a6-6861-44de-92d8-3abd18c7d2c8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:55.786554 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fb957a6-6861-44de-92d8-3abd18c7d2c8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:55.787642 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fb957a6-6861-44de-92d8-3abd18c7d2c8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:55.789335 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fb957a6-6861-44de-92d8-3abd18c7d2c8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:55.791099 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fb957a6-6861-44de-92d8-3abd18c7d2c8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:55.792120 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fb957a6-6861-44de-92d8-3abd18c7d2c8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:55.793097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fb957a6-6861-44de-92d8-3abd18c7d2c8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:55.833372 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:55.888625 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fb957a6-6861-44de-92d8-3abd18c7d2c8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:55.889421 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fb957a6-6861-44de-92d8-3abd18c7d2c8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:55.890131 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fb957a6-6861-44de-92d8-3abd18c7d2c8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:55.890919 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-4fb957a6-6861-44de-92d8-3abd18c7d2c8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lazy-loading 'fault' on Instance uuid b8caa499-489e-4644-b31a-8dc893a00b66 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:35:55.944516 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9e434d36-c898-4cf2-92ea-11b8d62e94dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:55.953877 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4fb957a6-6861-44de-92d8-3abd18c7d2c8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7425d9aefcf940709f3a3aad4166755c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0939af057f4940298089c8f89ec2865f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:55.955553 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-9e434d36-c898-4cf2-92ea-11b8d62e94dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.225835 Sep 01 16:35:55.956653 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 145/313] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:55 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:55.980857 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4fb957a6-6861-44de-92d8-3abd18c7d2c8 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 200 len: 1303 microversion: 2.1 time: 0.214602 Sep 01 16:35:55.981926 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 169/314] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:55 2022] GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 1303 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:56.985061 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-0c0f0afd-efbf-435d-a494-a0e56b172bcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:56.985679 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0c0f0afd-efbf-435d-a494-a0e56b172bcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:56.993218 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0c0f0afd-efbf-435d-a494-a0e56b172bcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:56.993739 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0c0f0afd-efbf-435d-a494-a0e56b172bcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:56.994194 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0c0f0afd-efbf-435d-a494-a0e56b172bcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:56.994989 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0c0f0afd-efbf-435d-a494-a0e56b172bcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:56.995433 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0c0f0afd-efbf-435d-a494-a0e56b172bcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:56.995853 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0c0f0afd-efbf-435d-a494-a0e56b172bcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:57.003092 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4d647123-a13e-439f-bf07-706f7a4d5be9 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:57.003693 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4d647123-a13e-439f-bf07-706f7a4d5be9 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] [instance: b8caa499-489e-4644-b31a-8dc893a00b66] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:57.006473 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=74 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:57.011989 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d647123-a13e-439f-bf07-706f7a4d5be9 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:57.012654 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d647123-a13e-439f-bf07-706f7a4d5be9 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:57.013079 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d647123-a13e-439f-bf07-706f7a4d5be9 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:57.013925 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d647123-a13e-439f-bf07-706f7a4d5be9 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:57.014411 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d647123-a13e-439f-bf07-706f7a4d5be9 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:57.014835 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d647123-a13e-439f-bf07-706f7a4d5be9 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:57.030717 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-4d647123-a13e-439f-bf07-706f7a4d5be9 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] HTTP exception thrown: Instance b8caa499-489e-4644-b31a-8dc893a00b66 could not be found. Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4d647123-a13e-439f-bf07-706f7a4d5be9 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Request method failure captured: Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 HTTP/1.1 Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN8_EhkAop5m3tKr-dAKaHJkZ5XwRxQ3vj-yKmI3-ezg2MUCR2F3zfXPQqoQH0rQUlXKJmneyKYNZtaHMjptgJk3a2vobLekUl2rIOH5FoUHuQX8jPp6e724D88WzrLkFnR3m6A27UNDhryJhVh_3tlo4bKtf095QcGB4-FEpw8iJe4 Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 0939af057f4940298089c8f89ec2865f Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesActionsTest-80650973 Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:35:57.032350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:35:57.033581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0939af057f4940298089c8f89ec2865f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0939af057f4940298089c8f89ec2865f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0939af057f4940298089c8f89ec2865f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0939af057f4940298089c8f89ec2865f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:35:57.033581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesActionsTest-80650973 Sep 01 16:35:57.033581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 0939af057f4940298089c8f89ec2865f Sep 01 16:35:57.033581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesActionsTest-80650973 Sep 01 16:35:57.033581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesActionsTest-80650973-project Sep 01 16:35:57.033581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:35:57.033581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:35:57.033581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: 7425d9aefcf940709f3a3aad4166755c Sep 01 16:35:57.033581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesActionsTest-80650973-project Sep 01 16:35:57.033581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:35:57.033581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance b8caa499-489e-4644-b31a-8dc893a00b66 could not be found. Sep 01 16:35:57.033581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': 'b8caa499-489e-4644-b31a-8dc893a00b66'} Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8caa499-489e-4644-b31a-8dc893a00b66 could not be found. Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:35:57.034298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8caa499-489e-4644-b31a-8dc893a00b66 could not be found. Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8caa499-489e-4644-b31a-8dc893a00b66 could not be found. Sep 01 16:35:57.035465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:35:57.036432 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4d647123-a13e-439f-bf07-706f7a4d5be9 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] Returning 404 to user: Instance b8caa499-489e-4644-b31a-8dc893a00b66 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:35:57.036432 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4d647123-a13e-439f-bf07-706f7a4d5be9 tempest-VolumesActionsTest-80650973 tempest-VolumesActionsTest-80650973-project] 10.222.0.18 "GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66" status: 404 len: 111 microversion: 2.1 time: 0.034456 Sep 01 16:35:57.036432 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 170/315] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:56 2022] GET /compute/v2.1/servers/b8caa499-489e-4644-b31a-8dc893a00b66 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:35:57.154880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0c0f0afd-efbf-435d-a494-a0e56b172bcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:57.163006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-0c0f0afd-efbf-435d-a494-a0e56b172bcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.187365 Sep 01 16:35:57.163436 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 146/316] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:56 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:58.185671 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-52b573d2-dc9a-4ef2-90e4-5419a7c53995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:58.186301 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-52b573d2-dc9a-4ef2-90e4-5419a7c53995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:58.193450 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52b573d2-dc9a-4ef2-90e4-5419a7c53995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:58.194053 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52b573d2-dc9a-4ef2-90e4-5419a7c53995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:58.194517 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52b573d2-dc9a-4ef2-90e4-5419a7c53995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:58.195941 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52b573d2-dc9a-4ef2-90e4-5419a7c53995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:58.196423 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52b573d2-dc9a-4ef2-90e4-5419a7c53995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:58.196835 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52b573d2-dc9a-4ef2-90e4-5419a7c53995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:58.349102 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-52b573d2-dc9a-4ef2-90e4-5419a7c53995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:58.357967 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-52b573d2-dc9a-4ef2-90e4-5419a7c53995 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.176786 Sep 01 16:35:58.359002 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 171/317] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:58 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:58.501057 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-886e2887-726d-4d0f-9586-fa44ec740ce9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:58.502128 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-886e2887-726d-4d0f-9586-fa44ec740ce9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:58.510162 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-886e2887-726d-4d0f-9586-fa44ec740ce9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:58.510920 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-886e2887-726d-4d0f-9586-fa44ec740ce9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:58.511404 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-886e2887-726d-4d0f-9586-fa44ec740ce9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:58.512105 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-886e2887-726d-4d0f-9586-fa44ec740ce9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:58.512579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-886e2887-726d-4d0f-9586-fa44ec740ce9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:58.513182 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-886e2887-726d-4d0f-9586-fa44ec740ce9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:58.537782 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-886e2887-726d-4d0f-9586-fa44ec740ce9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/ips" status: 200 len: 150 microversion: 2.20 time: 0.041952 Sep 01 16:35:58.538622 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 147/318] 10.222.0.18 () {60 vars in 1289 bytes} [Thu Sep 1 16:35:58 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:35:59.385690 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-668b0827-a054-4587-94c5-d167bdeaa153 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:59.386640 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-668b0827-a054-4587-94c5-d167bdeaa153 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:59.393161 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-668b0827-a054-4587-94c5-d167bdeaa153 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:59.393661 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-668b0827-a054-4587-94c5-d167bdeaa153 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:59.394089 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-668b0827-a054-4587-94c5-d167bdeaa153 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:59.394801 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-668b0827-a054-4587-94c5-d167bdeaa153 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:59.395244 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-668b0827-a054-4587-94c5-d167bdeaa153 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:59.395661 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-668b0827-a054-4587-94c5-d167bdeaa153 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:59.531935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-668b0827-a054-4587-94c5-d167bdeaa153 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:59.541283 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-668b0827-a054-4587-94c5-d167bdeaa153 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.160020 Sep 01 16:35:59.542011 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 172/319] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:59 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:00.562658 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-84cfcfc8-003a-4e37-8581-9c29d4facb04 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:00.563256 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-84cfcfc8-003a-4e37-8581-9c29d4facb04 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:00.569500 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-84cfcfc8-003a-4e37-8581-9c29d4facb04 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:00.570509 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-84cfcfc8-003a-4e37-8581-9c29d4facb04 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:00.570938 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-84cfcfc8-003a-4e37-8581-9c29d4facb04 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:00.571617 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-84cfcfc8-003a-4e37-8581-9c29d4facb04 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:00.572055 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-84cfcfc8-003a-4e37-8581-9c29d4facb04 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:00.572467 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-84cfcfc8-003a-4e37-8581-9c29d4facb04 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:00.709752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-84cfcfc8-003a-4e37-8581-9c29d4facb04 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:00.718165 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-84cfcfc8-003a-4e37-8581-9c29d4facb04 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.159243 Sep 01 16:36:00.718997 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 148/320] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:00 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:01.461970 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-20ede5df-18fc-42f0-b97f-04ad7fd8ffb8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:01.462565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-20ede5df-18fc-42f0-b97f-04ad7fd8ffb8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:01.468881 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20ede5df-18fc-42f0-b97f-04ad7fd8ffb8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:01.469353 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20ede5df-18fc-42f0-b97f-04ad7fd8ffb8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:01.469776 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20ede5df-18fc-42f0-b97f-04ad7fd8ffb8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:01.470483 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20ede5df-18fc-42f0-b97f-04ad7fd8ffb8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:01.470927 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20ede5df-18fc-42f0-b97f-04ad7fd8ffb8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:01.471340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20ede5df-18fc-42f0-b97f-04ad7fd8ffb8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:01.494600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-20ede5df-18fc-42f0-b97f-04ad7fd8ffb8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lazy-loading 'flavor' on Instance uuid 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:36:01.739870 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f93bc351-bdf0-42be-b0c1-f32bdaef6a96 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:01.740488 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f93bc351-bdf0-42be-b0c1-f32bdaef6a96 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:01.747446 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f93bc351-bdf0-42be-b0c1-f32bdaef6a96 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:01.747918 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f93bc351-bdf0-42be-b0c1-f32bdaef6a96 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:01.748456 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f93bc351-bdf0-42be-b0c1-f32bdaef6a96 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:01.749236 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f93bc351-bdf0-42be-b0c1-f32bdaef6a96 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:01.749947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f93bc351-bdf0-42be-b0c1-f32bdaef6a96 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:01.750404 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f93bc351-bdf0-42be-b0c1-f32bdaef6a96 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:01.902089 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f93bc351-bdf0-42be-b0c1-f32bdaef6a96 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:01.909940 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f93bc351-bdf0-42be-b0c1-f32bdaef6a96 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.174068 Sep 01 16:36:01.910537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 149/321] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:01 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:02.931020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-32814e5d-9a2f-4873-b851-272fed9a883e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:02.931702 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-32814e5d-9a2f-4873-b851-272fed9a883e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:02.937642 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32814e5d-9a2f-4873-b851-272fed9a883e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:02.938114 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32814e5d-9a2f-4873-b851-272fed9a883e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:02.938569 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32814e5d-9a2f-4873-b851-272fed9a883e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:02.939240 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32814e5d-9a2f-4873-b851-272fed9a883e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:02.939986 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32814e5d-9a2f-4873-b851-272fed9a883e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:02.940485 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32814e5d-9a2f-4873-b851-272fed9a883e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:03.091413 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-32814e5d-9a2f-4873-b851-272fed9a883e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:03.099543 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-32814e5d-9a2f-4873-b851-272fed9a883e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.172282 Sep 01 16:36:03.100105 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 150/322] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:02 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:03.537252 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-583aea90-37e9-4de5-b361-339488e3adff tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:03.537996 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-583aea90-37e9-4de5-b361-339488e3adff tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:03.545079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-583aea90-37e9-4de5-b361-339488e3adff tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:03.545519 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-583aea90-37e9-4de5-b361-339488e3adff tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:03.546330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-583aea90-37e9-4de5-b361-339488e3adff tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:03.547288 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-583aea90-37e9-4de5-b361-339488e3adff tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:03.548020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-583aea90-37e9-4de5-b361-339488e3adff tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:03.548631 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-583aea90-37e9-4de5-b361-339488e3adff tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:03.575640 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-583aea90-37e9-4de5-b361-339488e3adff tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/ips" status: 200 len: 145 microversion: 2.1 time: 0.042377 Sep 01 16:36:03.576462 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 151/323] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 1 16:36:03 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:36:04.120141 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a11111ed-4d76-4c2a-bf34-0415a7d022c0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:04.120831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a11111ed-4d76-4c2a-bf34-0415a7d022c0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:04.126989 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a11111ed-4d76-4c2a-bf34-0415a7d022c0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:04.127471 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a11111ed-4d76-4c2a-bf34-0415a7d022c0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:04.128110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a11111ed-4d76-4c2a-bf34-0415a7d022c0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:04.128778 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a11111ed-4d76-4c2a-bf34-0415a7d022c0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:04.129229 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a11111ed-4d76-4c2a-bf34-0415a7d022c0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:04.129649 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a11111ed-4d76-4c2a-bf34-0415a7d022c0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:04.294032 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a11111ed-4d76-4c2a-bf34-0415a7d022c0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:04.301770 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a11111ed-4d76-4c2a-bf34-0415a7d022c0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.185462 Sep 01 16:36:04.302575 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 152/324] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:04 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:05.327082 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-491ad138-e6cd-4be3-8107-9d0b147d00c8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:05.328315 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-491ad138-e6cd-4be3-8107-9d0b147d00c8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:05.331972 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:05.336642 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-491ad138-e6cd-4be3-8107-9d0b147d00c8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:05.337354 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-491ad138-e6cd-4be3-8107-9d0b147d00c8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:05.338046 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-491ad138-e6cd-4be3-8107-9d0b147d00c8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:05.339115 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-491ad138-e6cd-4be3-8107-9d0b147d00c8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:05.339875 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-491ad138-e6cd-4be3-8107-9d0b147d00c8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:05.340719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-491ad138-e6cd-4be3-8107-9d0b147d00c8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:05.496468 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-491ad138-e6cd-4be3-8107-9d0b147d00c8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:05.506465 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-491ad138-e6cd-4be3-8107-9d0b147d00c8 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.186273 Sep 01 16:36:05.507718 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 153/325] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:05 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:06.527735 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-925bb811-abcb-4b75-b48e-37d07e901479 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:06.528410 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-925bb811-abcb-4b75-b48e-37d07e901479 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:06.534298 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-925bb811-abcb-4b75-b48e-37d07e901479 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:06.534785 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-925bb811-abcb-4b75-b48e-37d07e901479 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:06.535211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-925bb811-abcb-4b75-b48e-37d07e901479 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:06.535892 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-925bb811-abcb-4b75-b48e-37d07e901479 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:06.536343 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-925bb811-abcb-4b75-b48e-37d07e901479 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:06.536759 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-925bb811-abcb-4b75-b48e-37d07e901479 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:06.671304 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-925bb811-abcb-4b75-b48e-37d07e901479 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:06.679438 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-925bb811-abcb-4b75-b48e-37d07e901479 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.155348 Sep 01 16:36:06.680254 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 154/326] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:06 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:07.313482 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f7f0b838-46c2-4ef7-bea8-40981579612c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c40f8e32-8672-4200-b2b2-99b3c3099117"}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:07.316911 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f7f0b838-46c2-4ef7-bea8-40981579612c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:07.324839 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f7f0b838-46c2-4ef7-bea8-40981579612c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:07.325413 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f7f0b838-46c2-4ef7-bea8-40981579612c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:07.326065 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f7f0b838-46c2-4ef7-bea8-40981579612c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:07.327095 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f7f0b838-46c2-4ef7-bea8-40981579612c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:07.327816 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f7f0b838-46c2-4ef7-bea8-40981579612c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:07.328738 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f7f0b838-46c2-4ef7-bea8-40981579612c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:07.731457 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f7f0b838-46c2-4ef7-bea8-40981579612c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "POST /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.422539 Sep 01 16:36:07.732284 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 155/327] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 1 16:36:07 2022] POST /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:07.740789 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1907370527", "imageRef": "46185d58-0d47-4c97-b590-0f4434aa5c9e", "flavorRef": "452", "networks": [{"uuid": "38acd0bc-b894-4eb9-a8c5-fadf4fec09f0"}]}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:09.509969 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-20ede5df-18fc-42f0-b97f-04ad7fd8ffb8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "POST /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/action" status: 202 len: 0 microversion: 2.20 time: 8.052440 Sep 01 16:36:09.514051 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 173/328] 10.222.0.18 () {62 vars in 1319 bytes} [Thu Sep 1 16:36:01 2022] POST /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/action => generated 0 bytes in 8054 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:36:09.520633 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.network.neutron [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] validate_networks() for [('38acd0bc-b894-4eb9-a8c5-fadf4fec09f0', None, None, None, None, None)] {{(pid=127178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:36:09.545632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c7d812ba-0999-4dd9-91c4-d87c7f6c26dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:09.546396 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c7d812ba-0999-4dd9-91c4-d87c7f6c26dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:09.568826 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c7d812ba-0999-4dd9-91c4-d87c7f6c26dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:09.569329 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c7d812ba-0999-4dd9-91c4-d87c7f6c26dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:09.573594 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c7d812ba-0999-4dd9-91c4-d87c7f6c26dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:09.574742 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c7d812ba-0999-4dd9-91c4-d87c7f6c26dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:09.575558 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c7d812ba-0999-4dd9-91c4-d87c7f6c26dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:09.578149 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c7d812ba-0999-4dd9-91c4-d87c7f6c26dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:09.865098 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c7d812ba-0999-4dd9-91c4-d87c7f6c26dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:09.873966 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c7d812ba-0999-4dd9-91c4-d87c7f6c26dc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.361683 Sep 01 16:36:09.886801 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 174/329] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:09 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:09.894225 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-944a47d3-4bfc-42bc-a156-080f1eebf061 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:09.895095 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-944a47d3-4bfc-42bc-a156-080f1eebf061 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:09.917378 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-944a47d3-4bfc-42bc-a156-080f1eebf061 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:09.919140 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-944a47d3-4bfc-42bc-a156-080f1eebf061 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:09.921097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-944a47d3-4bfc-42bc-a156-080f1eebf061 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:09.922035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-944a47d3-4bfc-42bc-a156-080f1eebf061 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:09.929482 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-944a47d3-4bfc-42bc-a156-080f1eebf061 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:09.930146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-944a47d3-4bfc-42bc-a156-080f1eebf061 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:10.028878 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Flavor limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:36:10.029391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Image limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:36:10.029977 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Flavor pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:36:10.030572 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Image pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:36:10.031059 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:36:10.041505 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:10.041996 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:10.042471 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:10.043192 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:10.043871 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:10.044294 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:10.061989 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Getting quotas for project 09b1f2c2ff4e4338acd2a3367a4fdee5. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:36:10.066062 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Getting quotas for user b4d4d3b4817e499196e01d1df96b4775 and project 09b1f2c2ff4e4338acd2a3367a4fdee5. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:36:10.077937 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Going to run 1 instances... {{(pid=127178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:36:10.080634 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46185d58-0d47-4c97-b590-0f4434aa5c9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:36:10.135497 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c7022adb-4550-4542-8152-54e089661a4c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.402133 Sep 01 16:36:10.142622 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 156/330] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:36:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:36:10.147964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-bfa71425-e7e6-438b-853c-6c35f5bb9f76 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:10.148575 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-bfa71425-e7e6-438b-853c-6c35f5bb9f76 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:10.218622 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-bfa71425-e7e6-438b-853c-6c35f5bb9f76 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:10.227193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-bfa71425-e7e6-438b-853c-6c35f5bb9f76 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1219 microversion: 2.1 time: 0.083239 Sep 01 16:36:10.241136 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-944a47d3-4bfc-42bc-a156-080f1eebf061 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:10.241264 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 157/331] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:10 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:10.249162 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-944a47d3-4bfc-42bc-a156-080f1eebf061 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:10.250889 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-944a47d3-4bfc-42bc-a156-080f1eebf061 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:10.252706 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-944a47d3-4bfc-42bc-a156-080f1eebf061 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.364200 Sep 01 16:36:10.253372 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 175/332] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:09 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:10.898991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-2a212708-c2dc-401e-801c-25eaad47cc76 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:10.900154 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-2a212708-c2dc-401e-801c-25eaad47cc76 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:10.907205 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a212708-c2dc-401e-801c-25eaad47cc76 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:10.907919 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a212708-c2dc-401e-801c-25eaad47cc76 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:10.908372 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a212708-c2dc-401e-801c-25eaad47cc76 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:10.909066 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a212708-c2dc-401e-801c-25eaad47cc76 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:10.909534 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a212708-c2dc-401e-801c-25eaad47cc76 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:10.910110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a212708-c2dc-401e-801c-25eaad47cc76 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:11.115762 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2a212708-c2dc-401e-801c-25eaad47cc76 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:11.129221 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-2a212708-c2dc-401e-801c-25eaad47cc76 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.236110 Sep 01 16:36:11.130046 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 158/333] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:10 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:11.248057 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ef382027-e1c2-4929-9659-a08aff7ab168 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:11.249555 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ef382027-e1c2-4929-9659-a08aff7ab168 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:11.256191 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ef382027-e1c2-4929-9659-a08aff7ab168 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:11.256872 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ef382027-e1c2-4929-9659-a08aff7ab168 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:11.258027 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ef382027-e1c2-4929-9659-a08aff7ab168 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:11.258943 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ef382027-e1c2-4929-9659-a08aff7ab168 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:11.259735 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ef382027-e1c2-4929-9659-a08aff7ab168 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:11.260860 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ef382027-e1c2-4929-9659-a08aff7ab168 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:11.279280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-9338d7ab-c68a-4f8b-b9c6-e9ac257749d1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:11.279976 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-9338d7ab-c68a-4f8b-b9c6-e9ac257749d1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:11.289212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9338d7ab-c68a-4f8b-b9c6-e9ac257749d1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:11.290067 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9338d7ab-c68a-4f8b-b9c6-e9ac257749d1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:11.290687 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9338d7ab-c68a-4f8b-b9c6-e9ac257749d1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:11.292447 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9338d7ab-c68a-4f8b-b9c6-e9ac257749d1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:11.293210 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9338d7ab-c68a-4f8b-b9c6-e9ac257749d1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:11.293738 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9338d7ab-c68a-4f8b-b9c6-e9ac257749d1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:11.356937 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ef382027-e1c2-4929-9659-a08aff7ab168 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:11.365280 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ef382027-e1c2-4929-9659-a08aff7ab168 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1223 microversion: 2.1 time: 0.121110 Sep 01 16:36:11.365854 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 176/334] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:11 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1223 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:11.489479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9338d7ab-c68a-4f8b-b9c6-e9ac257749d1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:11.500413 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9338d7ab-c68a-4f8b-b9c6-e9ac257749d1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:11.502134 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9338d7ab-c68a-4f8b-b9c6-e9ac257749d1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:11.503973 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-9338d7ab-c68a-4f8b-b9c6-e9ac257749d1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.229776 Sep 01 16:36:11.504649 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 159/335] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:11 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:36:12.152083 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c9834752-0204-407e-89c2-ea17d401ba2a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:12.153037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c9834752-0204-407e-89c2-ea17d401ba2a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:12.161384 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c9834752-0204-407e-89c2-ea17d401ba2a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:12.161872 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c9834752-0204-407e-89c2-ea17d401ba2a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:12.162385 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c9834752-0204-407e-89c2-ea17d401ba2a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:12.163212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c9834752-0204-407e-89c2-ea17d401ba2a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:12.163719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c9834752-0204-407e-89c2-ea17d401ba2a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:12.164172 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c9834752-0204-407e-89c2-ea17d401ba2a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:12.320518 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c9834752-0204-407e-89c2-ea17d401ba2a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:12.328425 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c9834752-0204-407e-89c2-ea17d401ba2a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.182478 Sep 01 16:36:12.328994 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 177/336] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:12 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:12.389249 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-699296e8-d898-42fa-9454-025030a08196 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:12.389842 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-699296e8-d898-42fa-9454-025030a08196 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:12.396245 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-699296e8-d898-42fa-9454-025030a08196 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:12.396715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-699296e8-d898-42fa-9454-025030a08196 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:12.397135 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-699296e8-d898-42fa-9454-025030a08196 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:12.397839 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-699296e8-d898-42fa-9454-025030a08196 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:12.398307 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-699296e8-d898-42fa-9454-025030a08196 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:12.398725 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-699296e8-d898-42fa-9454-025030a08196 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:12.487753 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-699296e8-d898-42fa-9454-025030a08196 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:12.496520 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-699296e8-d898-42fa-9454-025030a08196 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1223 microversion: 2.1 time: 0.111025 Sep 01 16:36:12.497097 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 160/337] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:12 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:12.527566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e8c7e500-87e6-408c-8d6b-4fe47c25e975 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:12.528166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e8c7e500-87e6-408c-8d6b-4fe47c25e975 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:12.534492 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8c7e500-87e6-408c-8d6b-4fe47c25e975 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:12.534968 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8c7e500-87e6-408c-8d6b-4fe47c25e975 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:12.535587 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8c7e500-87e6-408c-8d6b-4fe47c25e975 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:12.536266 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8c7e500-87e6-408c-8d6b-4fe47c25e975 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:12.536709 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8c7e500-87e6-408c-8d6b-4fe47c25e975 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:12.537119 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8c7e500-87e6-408c-8d6b-4fe47c25e975 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:12.755494 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e8c7e500-87e6-408c-8d6b-4fe47c25e975 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:12.768072 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e8c7e500-87e6-408c-8d6b-4fe47c25e975 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:12.773699 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e8c7e500-87e6-408c-8d6b-4fe47c25e975 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:12.775410 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e8c7e500-87e6-408c-8d6b-4fe47c25e975 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.251741 Sep 01 16:36:12.777175 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 178/338] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:12 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:36:13.348769 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-1de343d5-6ddc-433f-8992-341e91221eea tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:13.349646 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-1de343d5-6ddc-433f-8992-341e91221eea tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:13.356664 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1de343d5-6ddc-433f-8992-341e91221eea tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:13.357491 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1de343d5-6ddc-433f-8992-341e91221eea tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:13.358159 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1de343d5-6ddc-433f-8992-341e91221eea tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:13.359167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1de343d5-6ddc-433f-8992-341e91221eea tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:13.359823 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1de343d5-6ddc-433f-8992-341e91221eea tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:13.360474 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1de343d5-6ddc-433f-8992-341e91221eea tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:13.518274 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-70b48557-6337-416a-9ef5-2810c0b3bf4d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:13.519575 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-70b48557-6337-416a-9ef5-2810c0b3bf4d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:13.547597 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-70b48557-6337-416a-9ef5-2810c0b3bf4d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:13.548092 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-70b48557-6337-416a-9ef5-2810c0b3bf4d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:13.548532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-70b48557-6337-416a-9ef5-2810c0b3bf4d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:13.549249 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-70b48557-6337-416a-9ef5-2810c0b3bf4d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:13.549709 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-70b48557-6337-416a-9ef5-2810c0b3bf4d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:13.550137 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-70b48557-6337-416a-9ef5-2810c0b3bf4d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:13.644727 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-70b48557-6337-416a-9ef5-2810c0b3bf4d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:13.657989 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-70b48557-6337-416a-9ef5-2810c0b3bf4d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1271 microversion: 2.1 time: 0.144486 Sep 01 16:36:13.659581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 179/339] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:13 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:13.803374 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f9e37c8b-6fa7-4849-a31a-d7f2e3950c60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:13.804810 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f9e37c8b-6fa7-4849-a31a-d7f2e3950c60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:13.811500 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9e37c8b-6fa7-4849-a31a-d7f2e3950c60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:13.812497 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9e37c8b-6fa7-4849-a31a-d7f2e3950c60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:13.813106 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9e37c8b-6fa7-4849-a31a-d7f2e3950c60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:13.813998 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9e37c8b-6fa7-4849-a31a-d7f2e3950c60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:13.814671 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9e37c8b-6fa7-4849-a31a-d7f2e3950c60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:13.815270 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9e37c8b-6fa7-4849-a31a-d7f2e3950c60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:13.832323 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-1de343d5-6ddc-433f-8992-341e91221eea tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:13.840324 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-1de343d5-6ddc-433f-8992-341e91221eea tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.495219 Sep 01 16:36:13.854859 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 161/340] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:13 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:13.994736 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f9e37c8b-6fa7-4849-a31a-d7f2e3950c60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:14.004558 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f9e37c8b-6fa7-4849-a31a-d7f2e3950c60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:14.006379 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f9e37c8b-6fa7-4849-a31a-d7f2e3950c60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:14.007827 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f9e37c8b-6fa7-4849-a31a-d7f2e3950c60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.208403 Sep 01 16:36:14.010670 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 180/341] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:13 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:36:14.688461 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-252086e9-4424-4476-85b4-b0e0f9fdeaf4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:14.689487 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-252086e9-4424-4476-85b4-b0e0f9fdeaf4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:14.705620 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-252086e9-4424-4476-85b4-b0e0f9fdeaf4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:14.706932 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-252086e9-4424-4476-85b4-b0e0f9fdeaf4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:14.707623 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-252086e9-4424-4476-85b4-b0e0f9fdeaf4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:14.708570 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-252086e9-4424-4476-85b4-b0e0f9fdeaf4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:14.710467 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-252086e9-4424-4476-85b4-b0e0f9fdeaf4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:14.712305 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-252086e9-4424-4476-85b4-b0e0f9fdeaf4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:14.889962 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-90006083-7254-46f4-bd79-8e2133aa8b73 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:14.898367 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-90006083-7254-46f4-bd79-8e2133aa8b73 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:14.911188 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-252086e9-4424-4476-85b4-b0e0f9fdeaf4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:14.927227 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:14.932088 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90006083-7254-46f4-bd79-8e2133aa8b73 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:14.934037 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-252086e9-4424-4476-85b4-b0e0f9fdeaf4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1271 microversion: 2.1 time: 0.254434 Sep 01 16:36:14.934903 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90006083-7254-46f4-bd79-8e2133aa8b73 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:14.935738 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 162/342] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:14 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1271 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:14.953028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90006083-7254-46f4-bd79-8e2133aa8b73 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:14.954309 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90006083-7254-46f4-bd79-8e2133aa8b73 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:14.955005 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90006083-7254-46f4-bd79-8e2133aa8b73 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:14.955650 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90006083-7254-46f4-bd79-8e2133aa8b73 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:15.042220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c8e36d91-44fa-4e84-9a7b-f43582113dd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:15.043717 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c8e36d91-44fa-4e84-9a7b-f43582113dd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:15.088889 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c8e36d91-44fa-4e84-9a7b-f43582113dd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:15.089722 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c8e36d91-44fa-4e84-9a7b-f43582113dd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:15.104387 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c8e36d91-44fa-4e84-9a7b-f43582113dd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:15.110123 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c8e36d91-44fa-4e84-9a7b-f43582113dd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:15.120550 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c8e36d91-44fa-4e84-9a7b-f43582113dd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:15.125989 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c8e36d91-44fa-4e84-9a7b-f43582113dd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:15.284373 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-90006083-7254-46f4-bd79-8e2133aa8b73 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:15.299386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-90006083-7254-46f4-bd79-8e2133aa8b73 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.438395 Sep 01 16:36:15.315196 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 181/343] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:14 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:15.695655 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c8e36d91-44fa-4e84-9a7b-f43582113dd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:15.710607 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c8e36d91-44fa-4e84-9a7b-f43582113dd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:15.712353 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c8e36d91-44fa-4e84-9a7b-f43582113dd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:15.713680 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c8e36d91-44fa-4e84-9a7b-f43582113dd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.677897 Sep 01 16:36:15.714257 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 163/344] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:15 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:36:15.971126 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f290f754-34e1-48f4-b8ab-c4cb30a7dc75 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:15.973921 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f290f754-34e1-48f4-b8ab-c4cb30a7dc75 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:15.982547 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f290f754-34e1-48f4-b8ab-c4cb30a7dc75 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:15.983816 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f290f754-34e1-48f4-b8ab-c4cb30a7dc75 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:15.984740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f290f754-34e1-48f4-b8ab-c4cb30a7dc75 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:15.985850 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f290f754-34e1-48f4-b8ab-c4cb30a7dc75 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:15.986778 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f290f754-34e1-48f4-b8ab-c4cb30a7dc75 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:15.987737 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f290f754-34e1-48f4-b8ab-c4cb30a7dc75 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:16.111505 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f290f754-34e1-48f4-b8ab-c4cb30a7dc75 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:16.125413 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f290f754-34e1-48f4-b8ab-c4cb30a7dc75 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1279 microversion: 2.1 time: 0.168185 Sep 01 16:36:16.126782 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 182/345] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:15 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1279 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:16.321064 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-8950d11d-5dd1-4dbd-ad13-1e3078495d7d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:16.324736 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-8950d11d-5dd1-4dbd-ad13-1e3078495d7d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:16.354309 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8950d11d-5dd1-4dbd-ad13-1e3078495d7d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:16.357276 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8950d11d-5dd1-4dbd-ad13-1e3078495d7d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:16.357938 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8950d11d-5dd1-4dbd-ad13-1e3078495d7d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:16.358934 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8950d11d-5dd1-4dbd-ad13-1e3078495d7d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:16.363841 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8950d11d-5dd1-4dbd-ad13-1e3078495d7d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:16.365581 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8950d11d-5dd1-4dbd-ad13-1e3078495d7d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:16.740521 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-af3c1042-435b-451c-b4be-76dc99496993 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:16.741611 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-af3c1042-435b-451c-b4be-76dc99496993 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:16.756310 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af3c1042-435b-451c-b4be-76dc99496993 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:16.757075 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af3c1042-435b-451c-b4be-76dc99496993 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:16.757712 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af3c1042-435b-451c-b4be-76dc99496993 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:16.758755 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af3c1042-435b-451c-b4be-76dc99496993 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:16.759459 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af3c1042-435b-451c-b4be-76dc99496993 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:16.760064 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af3c1042-435b-451c-b4be-76dc99496993 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:16.949121 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-8950d11d-5dd1-4dbd-ad13-1e3078495d7d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:16.965334 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-8950d11d-5dd1-4dbd-ad13-1e3078495d7d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.648113 Sep 01 16:36:16.981423 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 164/346] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:16 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:17.008952 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-872aafd1-e4b6-4438-868c-c406114367cf tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:17.022168 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-872aafd1-e4b6-4438-868c-c406114367cf tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:17.023339 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-872aafd1-e4b6-4438-868c-c406114367cf tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:17.023771 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-872aafd1-e4b6-4438-868c-c406114367cf tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:17.238026 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-872aafd1-e4b6-4438-868c-c406114367cf tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Going to try to stop instance {{(pid=127178) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 16:36:17.318479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-872aafd1-e4b6-4438-868c-c406114367cf tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "POST /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/action" status: 202 len: 0 microversion: 2.1 time: 0.313684 Sep 01 16:36:17.319308 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 165/347] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 1 16:36:17 2022] POST /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:36:17.333234 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-dd933b1e-9e90-4707-8f9f-738ebca75151 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:17.334700 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-dd933b1e-9e90-4707-8f9f-738ebca75151 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:17.348779 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dd933b1e-9e90-4707-8f9f-738ebca75151 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:17.349655 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dd933b1e-9e90-4707-8f9f-738ebca75151 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:17.350351 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dd933b1e-9e90-4707-8f9f-738ebca75151 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:17.364539 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dd933b1e-9e90-4707-8f9f-738ebca75151 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:17.365143 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dd933b1e-9e90-4707-8f9f-738ebca75151 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:17.365687 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dd933b1e-9e90-4707-8f9f-738ebca75151 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:17.435001 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-af3c1042-435b-451c-b4be-76dc99496993 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:17.445163 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-af3c1042-435b-451c-b4be-76dc99496993 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:17.449679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-af3c1042-435b-451c-b4be-76dc99496993 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:17.450906 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-af3c1042-435b-451c-b4be-76dc99496993 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.715316 Sep 01 16:36:17.451458 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 183/348] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:16 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:36:17.468913 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-566cb2be-71e6-412d-a081-d0435914fa0f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:17.468913 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-566cb2be-71e6-412d-a081-d0435914fa0f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:17.491893 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-566cb2be-71e6-412d-a081-d0435914fa0f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:17.503096 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-566cb2be-71e6-412d-a081-d0435914fa0f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:17.503631 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-566cb2be-71e6-412d-a081-d0435914fa0f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:17.504442 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-566cb2be-71e6-412d-a081-d0435914fa0f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:17.504918 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-566cb2be-71e6-412d-a081-d0435914fa0f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:17.505369 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-566cb2be-71e6-412d-a081-d0435914fa0f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:17.523629 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-dd933b1e-9e90-4707-8f9f-738ebca75151 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:17.534341 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-dd933b1e-9e90-4707-8f9f-738ebca75151 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1277 microversion: 2.1 time: 0.212621 Sep 01 16:36:17.535176 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 166/349] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:17 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1277 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:17.542135 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:17.795273 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-566cb2be-71e6-412d-a081-d0435914fa0f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:17.807080 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-566cb2be-71e6-412d-a081-d0435914fa0f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1722 microversion: 2.1 time: 0.354558 Sep 01 16:36:17.807830 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 184/350] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:17 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1722 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:17.998443 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-40667d50-466a-40ac-85d6-50b43e5144b7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:17.999676 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-40667d50-466a-40ac-85d6-50b43e5144b7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:18.020856 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40667d50-466a-40ac-85d6-50b43e5144b7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:18.021825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40667d50-466a-40ac-85d6-50b43e5144b7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:18.023155 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40667d50-466a-40ac-85d6-50b43e5144b7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:18.025446 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40667d50-466a-40ac-85d6-50b43e5144b7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:18.026113 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40667d50-466a-40ac-85d6-50b43e5144b7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:18.026774 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40667d50-466a-40ac-85d6-50b43e5144b7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:18.480729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ec2e7780-70e8-4de1-8405-4c28a2a38edf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:18.483488 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ec2e7780-70e8-4de1-8405-4c28a2a38edf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:18.504644 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ec2e7780-70e8-4de1-8405-4c28a2a38edf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:18.505182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ec2e7780-70e8-4de1-8405-4c28a2a38edf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:18.505609 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ec2e7780-70e8-4de1-8405-4c28a2a38edf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:18.506328 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ec2e7780-70e8-4de1-8405-4c28a2a38edf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:18.510866 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ec2e7780-70e8-4de1-8405-4c28a2a38edf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:18.511312 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ec2e7780-70e8-4de1-8405-4c28a2a38edf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:18.683151 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-40667d50-466a-40ac-85d6-50b43e5144b7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:18.698391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-40667d50-466a-40ac-85d6-50b43e5144b7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.704464 Sep 01 16:36:18.721453 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 167/351] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:17 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:18.729721 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a15280b1-a397-4633-8d2b-abb6dddd91d5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:18.730750 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a15280b1-a397-4633-8d2b-abb6dddd91d5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:18.739666 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a15280b1-a397-4633-8d2b-abb6dddd91d5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:18.742215 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a15280b1-a397-4633-8d2b-abb6dddd91d5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:18.742962 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a15280b1-a397-4633-8d2b-abb6dddd91d5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:18.743910 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a15280b1-a397-4633-8d2b-abb6dddd91d5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:18.744580 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a15280b1-a397-4633-8d2b-abb6dddd91d5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:18.746431 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a15280b1-a397-4633-8d2b-abb6dddd91d5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:18.903920 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ec2e7780-70e8-4de1-8405-4c28a2a38edf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:18.919293 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ec2e7780-70e8-4de1-8405-4c28a2a38edf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:18.920749 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ec2e7780-70e8-4de1-8405-4c28a2a38edf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:18.926732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ec2e7780-70e8-4de1-8405-4c28a2a38edf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.451686 Sep 01 16:36:18.930760 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 185/352] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:18 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:18.943448 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-05531d17-a3d0-4870-a633-7ef07a092e1c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:18.944871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-05531d17-a3d0-4870-a633-7ef07a092e1c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:18.956384 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05531d17-a3d0-4870-a633-7ef07a092e1c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:18.957122 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05531d17-a3d0-4870-a633-7ef07a092e1c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:18.957780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05531d17-a3d0-4870-a633-7ef07a092e1c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:18.958730 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05531d17-a3d0-4870-a633-7ef07a092e1c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:18.964276 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05531d17-a3d0-4870-a633-7ef07a092e1c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:18.965067 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05531d17-a3d0-4870-a633-7ef07a092e1c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:19.000255 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a15280b1-a397-4633-8d2b-abb6dddd91d5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:19.012604 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a15280b1-a397-4633-8d2b-abb6dddd91d5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1319 microversion: 2.1 time: 0.291093 Sep 01 16:36:19.029983 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 168/353] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:18 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:19.365744 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-05531d17-a3d0-4870-a633-7ef07a092e1c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:19.385413 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-05531d17-a3d0-4870-a633-7ef07a092e1c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1722 microversion: 2.1 time: 0.453514 Sep 01 16:36:19.385991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 186/354] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:18 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1722 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:19.734044 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-32355b88-b4c1-4b4b-bb12-45a3b683939c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:19.734742 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-32355b88-b4c1-4b4b-bb12-45a3b683939c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:19.748661 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32355b88-b4c1-4b4b-bb12-45a3b683939c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:19.752147 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32355b88-b4c1-4b4b-bb12-45a3b683939c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:19.753884 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32355b88-b4c1-4b4b-bb12-45a3b683939c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:19.754736 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32355b88-b4c1-4b4b-bb12-45a3b683939c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:19.758597 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32355b88-b4c1-4b4b-bb12-45a3b683939c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:19.759459 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32355b88-b4c1-4b4b-bb12-45a3b683939c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:19.961174 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-409e8615-9e41-4479-b0b9-3f6e88a8dc34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:19.962559 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-409e8615-9e41-4479-b0b9-3f6e88a8dc34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:19.992288 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-409e8615-9e41-4479-b0b9-3f6e88a8dc34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:19.992798 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-409e8615-9e41-4479-b0b9-3f6e88a8dc34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:19.994483 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-409e8615-9e41-4479-b0b9-3f6e88a8dc34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:19.996295 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-409e8615-9e41-4479-b0b9-3f6e88a8dc34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:20.001145 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-409e8615-9e41-4479-b0b9-3f6e88a8dc34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:20.004257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-409e8615-9e41-4479-b0b9-3f6e88a8dc34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:20.052316 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:20.223892 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=8 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:20.236319 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-32355b88-b4c1-4b4b-bb12-45a3b683939c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:20.256438 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-32355b88-b4c1-4b4b-bb12-45a3b683939c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1499 microversion: 2.1 time: 0.528663 Sep 01 16:36:20.279238 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 169/355] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:19 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1499 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:20.293598 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-af05f0fa-41be-4cd2-8d83-e879fd69fc24 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:20.294204 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-af05f0fa-41be-4cd2-8d83-e879fd69fc24 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:20.294701 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-409e8615-9e41-4479-b0b9-3f6e88a8dc34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:20.312875 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-af05f0fa-41be-4cd2-8d83-e879fd69fc24 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:20.313358 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-af05f0fa-41be-4cd2-8d83-e879fd69fc24 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:20.313656 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-409e8615-9e41-4479-b0b9-3f6e88a8dc34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:20.313832 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-af05f0fa-41be-4cd2-8d83-e879fd69fc24 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:20.314547 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-af05f0fa-41be-4cd2-8d83-e879fd69fc24 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:20.314919 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-af05f0fa-41be-4cd2-8d83-e879fd69fc24 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:20.315335 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-af05f0fa-41be-4cd2-8d83-e879fd69fc24 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:20.322128 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-409e8615-9e41-4479-b0b9-3f6e88a8dc34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:20.324837 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-409e8615-9e41-4479-b0b9-3f6e88a8dc34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.372086 Sep 01 16:36:20.325974 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 187/356] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:19 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:36:20.332940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d07d8cfc-7f29-41c8-9542-51b203ab7645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd88143a-1bb2-4dcd-bb54-4513a6da39d8"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:20.338134 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d07d8cfc-7f29-41c8-9542-51b203ab7645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:20.380909 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d07d8cfc-7f29-41c8-9542-51b203ab7645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:20.385197 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d07d8cfc-7f29-41c8-9542-51b203ab7645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:20.388194 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d07d8cfc-7f29-41c8-9542-51b203ab7645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:20.389409 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d07d8cfc-7f29-41c8-9542-51b203ab7645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:20.391322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d07d8cfc-7f29-41c8-9542-51b203ab7645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:20.391978 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d07d8cfc-7f29-41c8-9542-51b203ab7645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:20.451613 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-d07d8cfc-7f29-41c8-9542-51b203ab7645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] HTTP exception thrown: Cannot 'attach_volume' instance 13e447e7-8805-447e-8cf9-7771733bf00f while it is in vm_state rescued Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d07d8cfc-7f29-41c8-9542-51b203ab7645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Request method failure captured: Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: POST /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f/os-volume_attachments HTTP/1.1 Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 74 Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN8F17LXR9QZKG1_VIEG9-p8CRv4W7TM6E6dScWkaJQxBYZmnEi3ulzPAVr0-b20dizp00dSNiiSfWFSUTO8kWHVwi7TysP99jGN0Cq7VR3f5DEHM8MBqhsccbwVjs5uyEAzYbVKihge-cMSlpBXs8gzVRuYafB1F18mDaUBDx4zRr4 Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: b4bbb5d3895c49fa8695d3bca946dbea Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1309500920 Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:36:20.454105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:36:20.455740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:36:20.455740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1309500920 Sep 01 16:36:20.455740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: b4bbb5d3895c49fa8695d3bca946dbea Sep 01 16:36:20.455740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1309500920 Sep 01 16:36:20.455740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-ServerRescueNegativeTestJSON-1309500920-project Sep 01 16:36:20.455740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:36:20.455740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:36:20.455740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: 8020db56bca04d61b5a6e40384c25715 Sep 01 16:36:20.455740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1309500920-project Sep 01 16:36:20.455740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Sep 01 16:36:20.455740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {"volumeAttachment": {"volumeId": "bd88143a-1bb2-4dcd-bb54-4513a6da39d8"}} Sep 01 16:36:20.455740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Cannot 'attach_volume' instance 13e447e7-8805-447e-8cf9-7771733bf00f while it is in vm_state rescued Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'server_id': '13e447e7-8805-447e-8cf9-7771733bf00f', 'body': {'volumeAttachment': {'volumeId': 'bd88143a-1bb2-4dcd-bb54-4513a6da39d8'}}} Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 13e447e7-8805-447e-8cf9-7771733bf00f in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:36:20.456732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 13e447e7-8805-447e-8cf9-7771733bf00f while it is in vm_state rescued Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:36:20.458167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:36:20.459526 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:36:20.459526 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:36:20.459526 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 13e447e7-8805-447e-8cf9-7771733bf00f while it is in vm_state rescued Sep 01 16:36:20.459526 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:36:20.462987 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d07d8cfc-7f29-41c8-9542-51b203ab7645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Returning 409 to user: Cannot 'attach_volume' instance 13e447e7-8805-447e-8cf9-7771733bf00f while it is in vm_state rescued {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:36:20.464118 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d07d8cfc-7f29-41c8-9542-51b203ab7645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "POST /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.136899 Sep 01 16:36:20.469303 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 188/357] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 1 16:36:20 2022] POST /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f/os-volume_attachments => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 16:36:20.474729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c63f8362-070b-44b8-8945-91dfcfcccd64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:20.476117 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c63f8362-070b-44b8-8945-91dfcfcccd64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:20.483098 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c63f8362-070b-44b8-8945-91dfcfcccd64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:20.488280 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c63f8362-070b-44b8-8945-91dfcfcccd64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:20.488738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c63f8362-070b-44b8-8945-91dfcfcccd64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:20.489474 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c63f8362-070b-44b8-8945-91dfcfcccd64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:20.489926 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c63f8362-070b-44b8-8945-91dfcfcccd64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:20.491291 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c63f8362-070b-44b8-8945-91dfcfcccd64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:20.695365 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-af05f0fa-41be-4cd2-8d83-e879fd69fc24 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:20.704270 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-af05f0fa-41be-4cd2-8d83-e879fd69fc24 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1319 microversion: 2.1 time: 0.420253 Sep 01 16:36:20.717785 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 170/358] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:20 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1319 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:20.744302 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-3ac4b8c8-50b4-45a4-a1c1-b965105f832d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:20.744952 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-3ac4b8c8-50b4-45a4-a1c1-b965105f832d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:20.777251 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3ac4b8c8-50b4-45a4-a1c1-b965105f832d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:20.777963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3ac4b8c8-50b4-45a4-a1c1-b965105f832d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:20.778620 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3ac4b8c8-50b4-45a4-a1c1-b965105f832d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:20.780712 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3ac4b8c8-50b4-45a4-a1c1-b965105f832d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:20.783508 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3ac4b8c8-50b4-45a4-a1c1-b965105f832d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:20.786016 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3ac4b8c8-50b4-45a4-a1c1-b965105f832d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:20.817956 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c63f8362-070b-44b8-8945-91dfcfcccd64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:20.842226 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c63f8362-070b-44b8-8945-91dfcfcccd64 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1722 microversion: 2.1 time: 0.370316 Sep 01 16:36:20.843282 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 189/359] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:20 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1722 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:20.927367 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-3ac4b8c8-50b4-45a4-a1c1-b965105f832d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "POST /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f/action" status: 202 len: 0 microversion: 2.1 time: 0.208127 Sep 01 16:36:20.928369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 171/360] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 1 16:36:20 2022] POST /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:36:20.935006 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-e102abd4-f8b5-4567-8cd6-c5c6617f4af1 req-b25d0d00-1193-4702-a65b-71dcbf30b914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa20f73-9965-4f95-b7a9-7d98e3822024", "tag": "896672fd-654c-408f-bad2-1993fb22ba9a"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:20.940244 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-de2db817-0ecd-4cd5-924f-e7bd90b9d62d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:20.941085 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-de2db817-0ecd-4cd5-924f-e7bd90b9d62d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:20.957423 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de2db817-0ecd-4cd5-924f-e7bd90b9d62d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:20.957840 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de2db817-0ecd-4cd5-924f-e7bd90b9d62d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:20.958456 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de2db817-0ecd-4cd5-924f-e7bd90b9d62d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:20.959178 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de2db817-0ecd-4cd5-924f-e7bd90b9d62d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:20.959917 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de2db817-0ecd-4cd5-924f-e7bd90b9d62d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:20.960836 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de2db817-0ecd-4cd5-924f-e7bd90b9d62d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:20.970371 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e102abd4-f8b5-4567-8cd6-c5c6617f4af1 req-b25d0d00-1193-4702-a65b-71dcbf30b914 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:20.971147 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e102abd4-f8b5-4567-8cd6-c5c6617f4af1 req-b25d0d00-1193-4702-a65b-71dcbf30b914 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:20.971725 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e102abd4-f8b5-4567-8cd6-c5c6617f4af1 req-b25d0d00-1193-4702-a65b-71dcbf30b914 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:20.989093 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-e102abd4-f8b5-4567-8cd6-c5c6617f4af1 req-b25d0d00-1193-4702-a65b-71dcbf30b914 service nova] Creating event network-changed:896672fd-654c-408f-bad2-1993fb22ba9a for instance 1fa20f73-9965-4f95-b7a9-7d98e3822024 on hv-cinder-85220 Sep 01 16:36:20.996760 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-e102abd4-f8b5-4567-8cd6-c5c6617f4af1 req-b25d0d00-1193-4702-a65b-71dcbf30b914 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070378 Sep 01 16:36:21.001602 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 190/361] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:36:21.150218 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-de2db817-0ecd-4cd5-924f-e7bd90b9d62d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:21.161728 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-de2db817-0ecd-4cd5-924f-e7bd90b9d62d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1507 microversion: 2.1 time: 0.228233 Sep 01 16:36:21.174266 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 172/362] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:20 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1507 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:21.355586 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-9e01980f-5e39-44e9-8500-0d13a8b91c16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:21.356539 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-9e01980f-5e39-44e9-8500-0d13a8b91c16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:21.363604 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9e01980f-5e39-44e9-8500-0d13a8b91c16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:21.364961 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9e01980f-5e39-44e9-8500-0d13a8b91c16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:21.365569 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9e01980f-5e39-44e9-8500-0d13a8b91c16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:21.366995 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9e01980f-5e39-44e9-8500-0d13a8b91c16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:21.367967 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9e01980f-5e39-44e9-8500-0d13a8b91c16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:21.368394 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9e01980f-5e39-44e9-8500-0d13a8b91c16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:21.502783 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9e01980f-5e39-44e9-8500-0d13a8b91c16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:21.512076 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9e01980f-5e39-44e9-8500-0d13a8b91c16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:21.512514 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-de9a2935-2d3a-4d4d-9673-9caa68bb1a64 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Action: 'create', calling method: .version_select at 0x7feeec2b2160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-346534431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYM7uUXr532HfKCyexXWy33ABOx0Go85D7iNV+TU3UlOcF9onMvC1VuaCd59csw+zf76LoxvPgDTE+jKi+pNezfymeLQwY8lYOtETtdFhKAK1FgQ06Z7hbL8w9Y9cDhUw=="}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:21.513770 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9e01980f-5e39-44e9-8500-0d13a8b91c16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:21.515058 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-9e01980f-5e39-44e9-8500-0d13a8b91c16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.166765 Sep 01 16:36:21.515745 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 173/363] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:21 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:36:21.529471 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-de9a2935-2d3a-4d4d-9673-9caa68bb1a64 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Getting quotas for project 4b6bf55e6c5e47f3895e135c4d6dc3ff. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:36:21.533440 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-de9a2935-2d3a-4d4d-9673-9caa68bb1a64 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Getting quotas for user a3059f5115bb4bad837daf9f18752143 and project 4b6bf55e6c5e47f3895e135c4d6dc3ff. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:36:21.557110 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-de9a2935-2d3a-4d4d-9673-9caa68bb1a64 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.227963 Sep 01 16:36:21.558028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 191/364] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 1 16:36:21 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:21.727015 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-5fb35c0c-f7c7-4bb1-ad10-4042cac45a25 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:21.727964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-5fb35c0c-f7c7-4bb1-ad10-4042cac45a25 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:21.734190 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5fb35c0c-f7c7-4bb1-ad10-4042cac45a25 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:21.734711 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5fb35c0c-f7c7-4bb1-ad10-4042cac45a25 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:21.735136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5fb35c0c-f7c7-4bb1-ad10-4042cac45a25 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:21.735815 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5fb35c0c-f7c7-4bb1-ad10-4042cac45a25 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:21.736420 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5fb35c0c-f7c7-4bb1-ad10-4042cac45a25 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:21.736884 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5fb35c0c-f7c7-4bb1-ad10-4042cac45a25 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:21.872478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e88359f6-0293-4021-bde2-1e9736904e6a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:21.874310 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e88359f6-0293-4021-bde2-1e9736904e6a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:21.883648 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e88359f6-0293-4021-bde2-1e9736904e6a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:21.884158 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e88359f6-0293-4021-bde2-1e9736904e6a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:21.884822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e88359f6-0293-4021-bde2-1e9736904e6a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:21.885527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e88359f6-0293-4021-bde2-1e9736904e6a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:21.885980 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e88359f6-0293-4021-bde2-1e9736904e6a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:21.886444 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e88359f6-0293-4021-bde2-1e9736904e6a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:21.894882 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-5fb35c0c-f7c7-4bb1-ad10-4042cac45a25 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:21.908205 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-5fb35c0c-f7c7-4bb1-ad10-4042cac45a25 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1319 microversion: 2.1 time: 0.186247 Sep 01 16:36:21.908786 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 174/365] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:21 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:22.036085 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e88359f6-0293-4021-bde2-1e9736904e6a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:22.045139 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e88359f6-0293-4021-bde2-1e9736904e6a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1722 microversion: 2.1 time: 0.179194 Sep 01 16:36:22.045639 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 192/366] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:21 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:22.188387 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c5b8659c-48e4-4ab5-95bd-ec0f4afc15e5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:22.188990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c5b8659c-48e4-4ab5-95bd-ec0f4afc15e5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:22.195870 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c5b8659c-48e4-4ab5-95bd-ec0f4afc15e5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:22.196348 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c5b8659c-48e4-4ab5-95bd-ec0f4afc15e5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:22.196802 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c5b8659c-48e4-4ab5-95bd-ec0f4afc15e5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:22.197497 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c5b8659c-48e4-4ab5-95bd-ec0f4afc15e5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:22.197940 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c5b8659c-48e4-4ab5-95bd-ec0f4afc15e5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:22.198384 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c5b8659c-48e4-4ab5-95bd-ec0f4afc15e5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:22.401808 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c5b8659c-48e4-4ab5-95bd-ec0f4afc15e5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:22.410945 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c5b8659c-48e4-4ab5-95bd-ec0f4afc15e5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1507 microversion: 2.1 time: 0.226247 Sep 01 16:36:22.412236 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 175/367] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:22 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1507 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:22.539337 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7aee0c90-346d-47e4-8093-fa68e1cf402d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:22.539940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7aee0c90-346d-47e4-8093-fa68e1cf402d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:22.546039 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7aee0c90-346d-47e4-8093-fa68e1cf402d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:22.546553 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7aee0c90-346d-47e4-8093-fa68e1cf402d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:22.546984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7aee0c90-346d-47e4-8093-fa68e1cf402d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:22.547672 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7aee0c90-346d-47e4-8093-fa68e1cf402d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:22.548125 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7aee0c90-346d-47e4-8093-fa68e1cf402d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:22.548535 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7aee0c90-346d-47e4-8093-fa68e1cf402d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:22.701564 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7aee0c90-346d-47e4-8093-fa68e1cf402d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:22.712988 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7aee0c90-346d-47e4-8093-fa68e1cf402d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:22.714612 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7aee0c90-346d-47e4-8093-fa68e1cf402d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:22.716401 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7aee0c90-346d-47e4-8093-fa68e1cf402d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.181056 Sep 01 16:36:22.717277 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 193/368] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:22 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:22.928692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b2665b4d-4d5f-4038-b87e-5184f052124d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:22.929979 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b2665b4d-4d5f-4038-b87e-5184f052124d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:22.936851 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b2665b4d-4d5f-4038-b87e-5184f052124d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:22.937572 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b2665b4d-4d5f-4038-b87e-5184f052124d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:22.938231 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b2665b4d-4d5f-4038-b87e-5184f052124d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:22.939274 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b2665b4d-4d5f-4038-b87e-5184f052124d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:22.939950 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b2665b4d-4d5f-4038-b87e-5184f052124d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:22.940443 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b2665b4d-4d5f-4038-b87e-5184f052124d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:23.069875 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-46e6e697-a27e-47c3-89a9-ed9df5757092 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:23.070547 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-46e6e697-a27e-47c3-89a9-ed9df5757092 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:23.078686 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46e6e697-a27e-47c3-89a9-ed9df5757092 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:23.079442 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46e6e697-a27e-47c3-89a9-ed9df5757092 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:23.080182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46e6e697-a27e-47c3-89a9-ed9df5757092 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:23.081055 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46e6e697-a27e-47c3-89a9-ed9df5757092 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:23.082206 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46e6e697-a27e-47c3-89a9-ed9df5757092 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:23.083563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46e6e697-a27e-47c3-89a9-ed9df5757092 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:23.088654 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b2665b4d-4d5f-4038-b87e-5184f052124d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:23.103515 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b2665b4d-4d5f-4038-b87e-5184f052124d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1319 microversion: 2.1 time: 0.178729 Sep 01 16:36:23.124194 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 176/369] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:22 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:23.251251 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-46e6e697-a27e-47c3-89a9-ed9df5757092 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:23.259947 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-46e6e697-a27e-47c3-89a9-ed9df5757092 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1722 microversion: 2.1 time: 0.195849 Sep 01 16:36:23.260510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 194/370] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:23 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:23.433910 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-9943a5f4-1002-40e2-9570-bb507c5b6ec5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:23.434927 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-9943a5f4-1002-40e2-9570-bb507c5b6ec5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:23.442071 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9943a5f4-1002-40e2-9570-bb507c5b6ec5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:23.442692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9943a5f4-1002-40e2-9570-bb507c5b6ec5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:23.443748 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9943a5f4-1002-40e2-9570-bb507c5b6ec5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:23.445449 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9943a5f4-1002-40e2-9570-bb507c5b6ec5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:23.446379 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9943a5f4-1002-40e2-9570-bb507c5b6ec5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:23.446964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9943a5f4-1002-40e2-9570-bb507c5b6ec5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:23.470561 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:23.741988 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7dede781-ca5f-4ee3-bed7-302b9a884cdc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:23.755004 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7dede781-ca5f-4ee3-bed7-302b9a884cdc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:23.774301 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7dede781-ca5f-4ee3-bed7-302b9a884cdc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:23.774950 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7dede781-ca5f-4ee3-bed7-302b9a884cdc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:23.775403 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7dede781-ca5f-4ee3-bed7-302b9a884cdc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:23.777040 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7dede781-ca5f-4ee3-bed7-302b9a884cdc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:23.780646 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7dede781-ca5f-4ee3-bed7-302b9a884cdc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:23.784776 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7dede781-ca5f-4ee3-bed7-302b9a884cdc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:23.846208 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9943a5f4-1002-40e2-9570-bb507c5b6ec5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:23.869827 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-9943a5f4-1002-40e2-9570-bb507c5b6ec5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1507 microversion: 2.1 time: 0.440376 Sep 01 16:36:23.870775 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 177/371] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:23 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1507 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:23.974708 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7dede781-ca5f-4ee3-bed7-302b9a884cdc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:23.992473 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7dede781-ca5f-4ee3-bed7-302b9a884cdc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:24.000452 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7dede781-ca5f-4ee3-bed7-302b9a884cdc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:24.001666 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7dede781-ca5f-4ee3-bed7-302b9a884cdc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.264646 Sep 01 16:36:24.003261 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 195/372] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:23 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:24.127439 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e798dbe2-0fb5-4d05-922a-db46bab811cb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:24.128832 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-e798dbe2-0fb5-4d05-922a-db46bab811cb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:24.139279 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e798dbe2-0fb5-4d05-922a-db46bab811cb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:24.140352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e798dbe2-0fb5-4d05-922a-db46bab811cb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:24.141116 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e798dbe2-0fb5-4d05-922a-db46bab811cb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:24.143255 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e798dbe2-0fb5-4d05-922a-db46bab811cb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:24.143810 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e798dbe2-0fb5-4d05-922a-db46bab811cb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:24.144362 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e798dbe2-0fb5-4d05-922a-db46bab811cb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:24.283997 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3f70035a-9b0e-43d7-ae80-e7ff2a120ba3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:24.284775 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3f70035a-9b0e-43d7-ae80-e7ff2a120ba3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:24.297664 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3f70035a-9b0e-43d7-ae80-e7ff2a120ba3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:24.298178 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3f70035a-9b0e-43d7-ae80-e7ff2a120ba3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:24.298665 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3f70035a-9b0e-43d7-ae80-e7ff2a120ba3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:24.299365 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3f70035a-9b0e-43d7-ae80-e7ff2a120ba3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:24.299855 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3f70035a-9b0e-43d7-ae80-e7ff2a120ba3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:24.300256 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3f70035a-9b0e-43d7-ae80-e7ff2a120ba3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:24.608118 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3f70035a-9b0e-43d7-ae80-e7ff2a120ba3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:24.618543 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3f70035a-9b0e-43d7-ae80-e7ff2a120ba3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1722 microversion: 2.1 time: 0.338280 Sep 01 16:36:24.619788 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 196/373] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:24 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1722 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:24.707943 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e798dbe2-0fb5-4d05-922a-db46bab811cb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:24.722022 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-e798dbe2-0fb5-4d05-922a-db46bab811cb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1319 microversion: 2.1 time: 0.601032 Sep 01 16:36:24.735147 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 178/374] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:24 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1319 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:24.917916 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-01e24dd4-db97-4adf-b6fe-02209ce1c1c9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:24.919558 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-01e24dd4-db97-4adf-b6fe-02209ce1c1c9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:24.927515 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01e24dd4-db97-4adf-b6fe-02209ce1c1c9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:24.928280 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01e24dd4-db97-4adf-b6fe-02209ce1c1c9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:24.928938 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01e24dd4-db97-4adf-b6fe-02209ce1c1c9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:24.929826 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01e24dd4-db97-4adf-b6fe-02209ce1c1c9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:24.930488 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01e24dd4-db97-4adf-b6fe-02209ce1c1c9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:24.931072 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01e24dd4-db97-4adf-b6fe-02209ce1c1c9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:25.036009 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b96989ae-0026-487a-bdb6-af2850d8c4e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:25.037094 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b96989ae-0026-487a-bdb6-af2850d8c4e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:25.058402 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b96989ae-0026-487a-bdb6-af2850d8c4e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:25.068116 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b96989ae-0026-487a-bdb6-af2850d8c4e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:25.068840 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b96989ae-0026-487a-bdb6-af2850d8c4e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:25.070073 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b96989ae-0026-487a-bdb6-af2850d8c4e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:25.071378 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b96989ae-0026-487a-bdb6-af2850d8c4e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:25.072192 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b96989ae-0026-487a-bdb6-af2850d8c4e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:25.184313 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-01e24dd4-db97-4adf-b6fe-02209ce1c1c9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:25.192410 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-01e24dd4-db97-4adf-b6fe-02209ce1c1c9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1507 microversion: 2.1 time: 0.288181 Sep 01 16:36:25.193014 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 197/375] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:24 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1507 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:25.457966 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b96989ae-0026-487a-bdb6-af2850d8c4e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:25.470791 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b96989ae-0026-487a-bdb6-af2850d8c4e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:25.472248 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b96989ae-0026-487a-bdb6-af2850d8c4e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:25.473416 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b96989ae-0026-487a-bdb6-af2850d8c4e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.441701 Sep 01 16:36:25.473964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 179/376] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:25 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:36:25.640957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-01d600a5-40c1-4368-86c4-7aeaac061982 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:25.641578 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-01d600a5-40c1-4368-86c4-7aeaac061982 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:25.648045 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01d600a5-40c1-4368-86c4-7aeaac061982 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:25.648514 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01d600a5-40c1-4368-86c4-7aeaac061982 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:25.648937 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01d600a5-40c1-4368-86c4-7aeaac061982 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:25.649606 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01d600a5-40c1-4368-86c4-7aeaac061982 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:25.650045 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01d600a5-40c1-4368-86c4-7aeaac061982 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:25.650488 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01d600a5-40c1-4368-86c4-7aeaac061982 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:25.745977 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d4716f83-2a09-4700-8247-dd50fdc8291a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:25.746770 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d4716f83-2a09-4700-8247-dd50fdc8291a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:25.752938 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4716f83-2a09-4700-8247-dd50fdc8291a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:25.753715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4716f83-2a09-4700-8247-dd50fdc8291a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:25.754263 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4716f83-2a09-4700-8247-dd50fdc8291a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:25.755055 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4716f83-2a09-4700-8247-dd50fdc8291a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:25.755833 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4716f83-2a09-4700-8247-dd50fdc8291a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:25.757123 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4716f83-2a09-4700-8247-dd50fdc8291a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:25.787423 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-01d600a5-40c1-4368-86c4-7aeaac061982 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:25.795656 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-01d600a5-40c1-4368-86c4-7aeaac061982 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1722 microversion: 2.1 time: 0.158557 Sep 01 16:36:25.796222 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 198/377] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:25 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:25.894955 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d4716f83-2a09-4700-8247-dd50fdc8291a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:25.904506 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d4716f83-2a09-4700-8247-dd50fdc8291a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1319 microversion: 2.1 time: 0.162602 Sep 01 16:36:25.905662 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 180/378] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:25 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:26.217010 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1097dcbe-90d7-45aa-8897-438d0f43a48b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:26.218304 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1097dcbe-90d7-45aa-8897-438d0f43a48b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:26.233752 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1097dcbe-90d7-45aa-8897-438d0f43a48b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:26.234628 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1097dcbe-90d7-45aa-8897-438d0f43a48b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:26.235279 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1097dcbe-90d7-45aa-8897-438d0f43a48b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:26.236219 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1097dcbe-90d7-45aa-8897-438d0f43a48b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:26.237068 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1097dcbe-90d7-45aa-8897-438d0f43a48b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:26.237844 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1097dcbe-90d7-45aa-8897-438d0f43a48b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:26.499208 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ae2c59be-8ea3-48f8-9c89-e157b8ded068 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:26.500036 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ae2c59be-8ea3-48f8-9c89-e157b8ded068 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:26.511128 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ae2c59be-8ea3-48f8-9c89-e157b8ded068 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:26.523255 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ae2c59be-8ea3-48f8-9c89-e157b8ded068 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:26.524066 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ae2c59be-8ea3-48f8-9c89-e157b8ded068 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:26.525524 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ae2c59be-8ea3-48f8-9c89-e157b8ded068 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:26.526944 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1097dcbe-90d7-45aa-8897-438d0f43a48b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:26.528791 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ae2c59be-8ea3-48f8-9c89-e157b8ded068 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:26.530748 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ae2c59be-8ea3-48f8-9c89-e157b8ded068 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:26.536790 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1097dcbe-90d7-45aa-8897-438d0f43a48b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1507 microversion: 2.1 time: 0.324689 Sep 01 16:36:26.537579 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 199/379] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:26 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1507 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:26.708897 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ae2c59be-8ea3-48f8-9c89-e157b8ded068 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:26.718073 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ae2c59be-8ea3-48f8-9c89-e157b8ded068 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:26.719522 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ae2c59be-8ea3-48f8-9c89-e157b8ded068 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:26.720911 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ae2c59be-8ea3-48f8-9c89-e157b8ded068 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.226737 Sep 01 16:36:26.721464 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 181/380] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:26 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:26.817012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ab7f6b61-2ff9-455b-a148-ebfec85e9f34 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:26.817665 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ab7f6b61-2ff9-455b-a148-ebfec85e9f34 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:26.824992 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab7f6b61-2ff9-455b-a148-ebfec85e9f34 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:26.825473 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab7f6b61-2ff9-455b-a148-ebfec85e9f34 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:26.825918 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab7f6b61-2ff9-455b-a148-ebfec85e9f34 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:26.826669 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab7f6b61-2ff9-455b-a148-ebfec85e9f34 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:26.827115 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab7f6b61-2ff9-455b-a148-ebfec85e9f34 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:26.827527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab7f6b61-2ff9-455b-a148-ebfec85e9f34 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:26.927089 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f39c7b7f-26f2-4610-9b51-8340e0fd42da tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:26.928033 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f39c7b7f-26f2-4610-9b51-8340e0fd42da tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:26.934382 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f39c7b7f-26f2-4610-9b51-8340e0fd42da tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:26.934933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f39c7b7f-26f2-4610-9b51-8340e0fd42da tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:26.935663 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f39c7b7f-26f2-4610-9b51-8340e0fd42da tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:26.936572 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f39c7b7f-26f2-4610-9b51-8340e0fd42da tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:26.937213 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f39c7b7f-26f2-4610-9b51-8340e0fd42da tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:26.938006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f39c7b7f-26f2-4610-9b51-8340e0fd42da tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:26.969728 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ab7f6b61-2ff9-455b-a148-ebfec85e9f34 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:26.978403 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ab7f6b61-2ff9-455b-a148-ebfec85e9f34 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1722 microversion: 2.1 time: 0.165351 Sep 01 16:36:26.978975 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 200/381] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:26 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:27.078776 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f39c7b7f-26f2-4610-9b51-8340e0fd42da tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:27.087235 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f39c7b7f-26f2-4610-9b51-8340e0fd42da tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1319 microversion: 2.1 time: 0.164474 Sep 01 16:36:27.088266 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 182/382] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:26 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:27.559960 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cffdb0d1-1678-4cc3-babb-e6d1fdf4b884 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:27.560660 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cffdb0d1-1678-4cc3-babb-e6d1fdf4b884 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:27.563893 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:27.571169 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cffdb0d1-1678-4cc3-babb-e6d1fdf4b884 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:27.571516 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cffdb0d1-1678-4cc3-babb-e6d1fdf4b884 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:27.571952 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cffdb0d1-1678-4cc3-babb-e6d1fdf4b884 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:27.572658 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cffdb0d1-1678-4cc3-babb-e6d1fdf4b884 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:27.573181 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cffdb0d1-1678-4cc3-babb-e6d1fdf4b884 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:27.573670 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cffdb0d1-1678-4cc3-babb-e6d1fdf4b884 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:27.736337 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cffdb0d1-1678-4cc3-babb-e6d1fdf4b884 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:27.745183 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b6c73241-c2e3-445d-9b99-a15e84a27457 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:27.745936 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b6c73241-c2e3-445d-9b99-a15e84a27457 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:27.752466 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cffdb0d1-1678-4cc3-babb-e6d1fdf4b884 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1507 microversion: 2.1 time: 0.196601 Sep 01 16:36:27.758387 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 201/383] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:27 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:27.767957 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b6c73241-c2e3-445d-9b99-a15e84a27457 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:27.768656 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b6c73241-c2e3-445d-9b99-a15e84a27457 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:27.769275 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b6c73241-c2e3-445d-9b99-a15e84a27457 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:27.769985 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b6c73241-c2e3-445d-9b99-a15e84a27457 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:27.770607 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b6c73241-c2e3-445d-9b99-a15e84a27457 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:27.771167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b6c73241-c2e3-445d-9b99-a15e84a27457 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:27.943627 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b6c73241-c2e3-445d-9b99-a15e84a27457 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:27.953553 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b6c73241-c2e3-445d-9b99-a15e84a27457 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:27.959011 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b6c73241-c2e3-445d-9b99-a15e84a27457 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:27.964380 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b6c73241-c2e3-445d-9b99-a15e84a27457 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1743 microversion: 2.20 time: 0.220560 Sep 01 16:36:27.980591 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 183/384] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:27 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1743 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:28.003003 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6981854b-f30a-42e0-a7f6-5312e5cd513c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:28.004406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6981854b-f30a-42e0-a7f6-5312e5cd513c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:28.015073 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6981854b-f30a-42e0-a7f6-5312e5cd513c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:28.015748 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6981854b-f30a-42e0-a7f6-5312e5cd513c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:28.016337 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6981854b-f30a-42e0-a7f6-5312e5cd513c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:28.017195 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6981854b-f30a-42e0-a7f6-5312e5cd513c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:28.017808 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6981854b-f30a-42e0-a7f6-5312e5cd513c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:28.018409 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6981854b-f30a-42e0-a7f6-5312e5cd513c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:28.109112 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a87ac48f-ed32-4f27-b322-a25d6fa3a5b8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:28.110376 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a87ac48f-ed32-4f27-b322-a25d6fa3a5b8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:28.117928 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a87ac48f-ed32-4f27-b322-a25d6fa3a5b8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:28.118448 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a87ac48f-ed32-4f27-b322-a25d6fa3a5b8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:28.118885 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a87ac48f-ed32-4f27-b322-a25d6fa3a5b8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:28.119594 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a87ac48f-ed32-4f27-b322-a25d6fa3a5b8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:28.120097 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a87ac48f-ed32-4f27-b322-a25d6fa3a5b8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:28.120524 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a87ac48f-ed32-4f27-b322-a25d6fa3a5b8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:28.189004 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6981854b-f30a-42e0-a7f6-5312e5cd513c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:28.197801 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6981854b-f30a-42e0-a7f6-5312e5cd513c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1722 microversion: 2.1 time: 0.201662 Sep 01 16:36:28.198377 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 202/385] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:27 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:28.264916 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a87ac48f-ed32-4f27-b322-a25d6fa3a5b8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:28.273457 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a87ac48f-ed32-4f27-b322-a25d6fa3a5b8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1319 microversion: 2.1 time: 0.168117 Sep 01 16:36:28.274250 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 184/386] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:28 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:28.779173 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-105fdc83-bba9-4418-888f-331f144b4e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:28.779767 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-105fdc83-bba9-4418-888f-331f144b4e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:28.786067 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-105fdc83-bba9-4418-888f-331f144b4e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:28.786571 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-105fdc83-bba9-4418-888f-331f144b4e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:28.786996 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-105fdc83-bba9-4418-888f-331f144b4e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:28.787816 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-105fdc83-bba9-4418-888f-331f144b4e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:28.788644 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-105fdc83-bba9-4418-888f-331f144b4e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:28.789057 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-105fdc83-bba9-4418-888f-331f144b4e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:28.793085 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:28.930812 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-105fdc83-bba9-4418-888f-331f144b4e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:28.940176 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-105fdc83-bba9-4418-888f-331f144b4e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1507 microversion: 2.1 time: 0.164874 Sep 01 16:36:28.940832 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 203/387] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:28 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:28.998758 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-0915cae5-ad98-45c6-8344-40e1f81515be tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:28.999390 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0915cae5-ad98-45c6-8344-40e1f81515be tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:29.006295 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0915cae5-ad98-45c6-8344-40e1f81515be tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:29.007301 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0915cae5-ad98-45c6-8344-40e1f81515be tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:29.008041 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0915cae5-ad98-45c6-8344-40e1f81515be tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:29.008739 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0915cae5-ad98-45c6-8344-40e1f81515be tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:29.009319 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0915cae5-ad98-45c6-8344-40e1f81515be tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:29.009904 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0915cae5-ad98-45c6-8344-40e1f81515be tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:29.153819 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0915cae5-ad98-45c6-8344-40e1f81515be tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:29.164481 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0915cae5-ad98-45c6-8344-40e1f81515be tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:29.166948 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0915cae5-ad98-45c6-8344-40e1f81515be tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:29.170142 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-0915cae5-ad98-45c6-8344-40e1f81515be tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1743 microversion: 2.20 time: 0.175190 Sep 01 16:36:29.170987 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 185/388] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:28 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:29.221483 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9c4d2386-42ce-4491-b82a-b7e91a230b4e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:29.222703 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9c4d2386-42ce-4491-b82a-b7e91a230b4e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:29.231471 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c4d2386-42ce-4491-b82a-b7e91a230b4e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:29.232131 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c4d2386-42ce-4491-b82a-b7e91a230b4e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:29.232569 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c4d2386-42ce-4491-b82a-b7e91a230b4e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:29.233508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c4d2386-42ce-4491-b82a-b7e91a230b4e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:29.233957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c4d2386-42ce-4491-b82a-b7e91a230b4e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:29.234512 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c4d2386-42ce-4491-b82a-b7e91a230b4e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:29.295365 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-aaa0c145-a9bb-4463-bdd7-6313429c2bbb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:29.296726 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-aaa0c145-a9bb-4463-bdd7-6313429c2bbb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:29.304800 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-aaa0c145-a9bb-4463-bdd7-6313429c2bbb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:29.305531 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-aaa0c145-a9bb-4463-bdd7-6313429c2bbb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:29.305964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-aaa0c145-a9bb-4463-bdd7-6313429c2bbb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:29.306761 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-aaa0c145-a9bb-4463-bdd7-6313429c2bbb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:29.307199 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-aaa0c145-a9bb-4463-bdd7-6313429c2bbb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:29.307621 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-aaa0c145-a9bb-4463-bdd7-6313429c2bbb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:29.398710 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9c4d2386-42ce-4491-b82a-b7e91a230b4e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:29.408820 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9c4d2386-42ce-4491-b82a-b7e91a230b4e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1722 microversion: 2.1 time: 0.191770 Sep 01 16:36:29.409404 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 204/389] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:29 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:29.500033 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-aaa0c145-a9bb-4463-bdd7-6313429c2bbb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:29.500387 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-aaa0c145-a9bb-4463-bdd7-6313429c2bbb tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1319 microversion: 2.1 time: 0.210377 Sep 01 16:36:29.500997 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 186/390] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:29 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:29.961468 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2f13d5d6-f014-4baa-a7e3-8a65c7ef8146 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:29.962383 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2f13d5d6-f014-4baa-a7e3-8a65c7ef8146 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:29.968422 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f13d5d6-f014-4baa-a7e3-8a65c7ef8146 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:29.968898 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f13d5d6-f014-4baa-a7e3-8a65c7ef8146 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:29.969330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f13d5d6-f014-4baa-a7e3-8a65c7ef8146 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:29.970028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f13d5d6-f014-4baa-a7e3-8a65c7ef8146 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:29.970510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f13d5d6-f014-4baa-a7e3-8a65c7ef8146 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:29.970923 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f13d5d6-f014-4baa-a7e3-8a65c7ef8146 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:30.112399 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2f13d5d6-f014-4baa-a7e3-8a65c7ef8146 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:30.120191 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2f13d5d6-f014-4baa-a7e3-8a65c7ef8146 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1507 microversion: 2.1 time: 0.162869 Sep 01 16:36:30.120832 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 205/391] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:29 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:30.195602 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-0a149fa7-fd3e-4fd9-9e1e-e6cddc645fd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:30.196233 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0a149fa7-fd3e-4fd9-9e1e-e6cddc645fd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:30.203692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0a149fa7-fd3e-4fd9-9e1e-e6cddc645fd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:30.204345 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0a149fa7-fd3e-4fd9-9e1e-e6cddc645fd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:30.205176 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0a149fa7-fd3e-4fd9-9e1e-e6cddc645fd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:30.206056 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0a149fa7-fd3e-4fd9-9e1e-e6cddc645fd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:30.206681 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0a149fa7-fd3e-4fd9-9e1e-e6cddc645fd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:30.207247 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0a149fa7-fd3e-4fd9-9e1e-e6cddc645fd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:30.348875 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0a149fa7-fd3e-4fd9-9e1e-e6cddc645fd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:30.361584 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0a149fa7-fd3e-4fd9-9e1e-e6cddc645fd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:30.363446 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0a149fa7-fd3e-4fd9-9e1e-e6cddc645fd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:30.364957 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-0a149fa7-fd3e-4fd9-9e1e-e6cddc645fd7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1743 microversion: 2.20 time: 0.174478 Sep 01 16:36:30.379234 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 187/392] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:30 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1743 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:30.434148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-67373817-d50a-42f2-b0c5-15eb102210c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:30.435081 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-67373817-d50a-42f2-b0c5-15eb102210c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:30.442890 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-67373817-d50a-42f2-b0c5-15eb102210c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:30.443474 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-67373817-d50a-42f2-b0c5-15eb102210c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:30.445078 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-67373817-d50a-42f2-b0c5-15eb102210c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:30.445870 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-67373817-d50a-42f2-b0c5-15eb102210c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:30.446899 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-67373817-d50a-42f2-b0c5-15eb102210c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:30.447642 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-67373817-d50a-42f2-b0c5-15eb102210c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:30.524720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b9c2895a-dffc-44ce-9b31-cf0a0bd86cc6 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:30.525319 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b9c2895a-dffc-44ce-9b31-cf0a0bd86cc6 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:30.540080 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b9c2895a-dffc-44ce-9b31-cf0a0bd86cc6 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:30.541570 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b9c2895a-dffc-44ce-9b31-cf0a0bd86cc6 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:30.542150 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b9c2895a-dffc-44ce-9b31-cf0a0bd86cc6 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:30.542951 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b9c2895a-dffc-44ce-9b31-cf0a0bd86cc6 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:30.543535 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b9c2895a-dffc-44ce-9b31-cf0a0bd86cc6 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:30.543963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b9c2895a-dffc-44ce-9b31-cf0a0bd86cc6 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:30.599808 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-67373817-d50a-42f2-b0c5-15eb102210c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:30.609423 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-67373817-d50a-42f2-b0c5-15eb102210c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1722 microversion: 2.1 time: 0.181184 Sep 01 16:36:30.610029 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 206/393] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:30 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:30.738170 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b9c2895a-dffc-44ce-9b31-cf0a0bd86cc6 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:30.748880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b9c2895a-dffc-44ce-9b31-cf0a0bd86cc6 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1319 microversion: 2.1 time: 0.230310 Sep 01 16:36:30.749657 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 188/394] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:30 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:31.145078 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bb34c089-579f-4363-a9da-e01327f415d7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:31.145995 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bb34c089-579f-4363-a9da-e01327f415d7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:31.155062 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb34c089-579f-4363-a9da-e01327f415d7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:31.155062 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb34c089-579f-4363-a9da-e01327f415d7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:31.155062 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb34c089-579f-4363-a9da-e01327f415d7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:31.155062 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb34c089-579f-4363-a9da-e01327f415d7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:31.155534 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb34c089-579f-4363-a9da-e01327f415d7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:31.155534 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bb34c089-579f-4363-a9da-e01327f415d7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:31.359241 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bb34c089-579f-4363-a9da-e01327f415d7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:31.369320 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bb34c089-579f-4363-a9da-e01327f415d7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1507 microversion: 2.1 time: 0.228173 Sep 01 16:36:31.370281 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 207/395] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:31 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1507 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:31.392264 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-09fb57a4-580a-44ba-854d-f2a54eea987c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:31.392957 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-09fb57a4-580a-44ba-854d-f2a54eea987c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:31.400356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09fb57a4-580a-44ba-854d-f2a54eea987c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:31.403024 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09fb57a4-580a-44ba-854d-f2a54eea987c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:31.403706 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09fb57a4-580a-44ba-854d-f2a54eea987c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:31.407094 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09fb57a4-580a-44ba-854d-f2a54eea987c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:31.407595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09fb57a4-580a-44ba-854d-f2a54eea987c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:31.408066 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09fb57a4-580a-44ba-854d-f2a54eea987c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:31.600385 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-09fb57a4-580a-44ba-854d-f2a54eea987c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:31.609607 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-09fb57a4-580a-44ba-854d-f2a54eea987c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:31.611454 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-09fb57a4-580a-44ba-854d-f2a54eea987c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:31.612808 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-09fb57a4-580a-44ba-854d-f2a54eea987c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1743 microversion: 2.20 time: 0.224534 Sep 01 16:36:31.613529 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 189/396] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:31 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1743 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:31.634646 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9e4573f3-9923-425c-b5d6-878eb42199b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:31.635412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9e4573f3-9923-425c-b5d6-878eb42199b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:31.642205 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=4 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:31.644701 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e4573f3-9923-425c-b5d6-878eb42199b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:31.645505 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e4573f3-9923-425c-b5d6-878eb42199b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:31.646281 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e4573f3-9923-425c-b5d6-878eb42199b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:31.647261 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e4573f3-9923-425c-b5d6-878eb42199b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:31.647910 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e4573f3-9923-425c-b5d6-878eb42199b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:31.648707 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e4573f3-9923-425c-b5d6-878eb42199b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:31.772898 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-493bb484-ecac-49f6-b521-e05d8cb5f2e2 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:31.773498 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-493bb484-ecac-49f6-b521-e05d8cb5f2e2 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:31.779671 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-493bb484-ecac-49f6-b521-e05d8cb5f2e2 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:31.780352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-493bb484-ecac-49f6-b521-e05d8cb5f2e2 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:31.780776 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-493bb484-ecac-49f6-b521-e05d8cb5f2e2 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:31.781655 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-493bb484-ecac-49f6-b521-e05d8cb5f2e2 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:31.782092 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-493bb484-ecac-49f6-b521-e05d8cb5f2e2 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:31.782686 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-493bb484-ecac-49f6-b521-e05d8cb5f2e2 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:31.802586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9e4573f3-9923-425c-b5d6-878eb42199b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:31.813900 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9e4573f3-9923-425c-b5d6-878eb42199b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1722 microversion: 2.1 time: 0.185088 Sep 01 16:36:31.815043 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 208/397] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:31 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:31.938464 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-493bb484-ecac-49f6-b521-e05d8cb5f2e2 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:31.947021 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-493bb484-ecac-49f6-b521-e05d8cb5f2e2 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1319 microversion: 2.1 time: 0.179301 Sep 01 16:36:31.947685 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 190/398] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:31 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:32.391280 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4679ede6-0e83-435d-86de-c3386691d0ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:32.392521 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4679ede6-0e83-435d-86de-c3386691d0ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:32.401438 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4679ede6-0e83-435d-86de-c3386691d0ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:32.402113 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4679ede6-0e83-435d-86de-c3386691d0ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:32.402610 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4679ede6-0e83-435d-86de-c3386691d0ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:32.403651 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4679ede6-0e83-435d-86de-c3386691d0ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:32.404255 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4679ede6-0e83-435d-86de-c3386691d0ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:32.404828 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4679ede6-0e83-435d-86de-c3386691d0ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:32.564653 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4679ede6-0e83-435d-86de-c3386691d0ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:32.570510 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-01ab53b1-c5cb-4002-bcec-6cd05ffb1736 req-30fd38e3-37db-4cfb-8f16-3203d4d52028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0958ba3f-7f1d-4fa1-bff7-4459d3945b6f", "name": "network-vif-plugged", "status": "completed", "tag": "46daf8ff-8552-45e4-b4ac-b60b47e199de"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:32.577174 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4679ede6-0e83-435d-86de-c3386691d0ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1507 microversion: 2.1 time: 0.189324 Sep 01 16:36:32.578392 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 209/399] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:32 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1507 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:32.587652 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-01ab53b1-c5cb-4002-bcec-6cd05ffb1736 req-30fd38e3-37db-4cfb-8f16-3203d4d52028 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:32.588344 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-01ab53b1-c5cb-4002-bcec-6cd05ffb1736 req-30fd38e3-37db-4cfb-8f16-3203d4d52028 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:32.588965 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-01ab53b1-c5cb-4002-bcec-6cd05ffb1736 req-30fd38e3-37db-4cfb-8f16-3203d4d52028 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:32.603984 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-01ab53b1-c5cb-4002-bcec-6cd05ffb1736 req-30fd38e3-37db-4cfb-8f16-3203d4d52028 service nova] Creating event network-vif-plugged:46daf8ff-8552-45e4-b4ac-b60b47e199de for instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f on hv-cinder-85220 Sep 01 16:36:32.609404 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-01ab53b1-c5cb-4002-bcec-6cd05ffb1736 req-30fd38e3-37db-4cfb-8f16-3203d4d52028 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043423 Sep 01 16:36:32.610142 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 191/400] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:36:32.640049 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-63ca451d-228a-4100-80d2-c612727c1bdd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:32.642792 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-63ca451d-228a-4100-80d2-c612727c1bdd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:32.649927 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-63ca451d-228a-4100-80d2-c612727c1bdd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:32.650667 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-63ca451d-228a-4100-80d2-c612727c1bdd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:32.651339 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-63ca451d-228a-4100-80d2-c612727c1bdd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:32.652217 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-63ca451d-228a-4100-80d2-c612727c1bdd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:32.652890 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-63ca451d-228a-4100-80d2-c612727c1bdd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:32.653493 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-63ca451d-228a-4100-80d2-c612727c1bdd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:32.798424 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-63ca451d-228a-4100-80d2-c612727c1bdd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:32.807848 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-63ca451d-228a-4100-80d2-c612727c1bdd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:32.809343 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-63ca451d-228a-4100-80d2-c612727c1bdd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:32.810470 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-63ca451d-228a-4100-80d2-c612727c1bdd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1743 microversion: 2.20 time: 0.175693 Sep 01 16:36:32.811027 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 210/401] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:32 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:32.836920 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-77b5cb06-5b40-48ea-8172-67fea9a77fa2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:32.837739 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-77b5cb06-5b40-48ea-8172-67fea9a77fa2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:32.844358 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-77b5cb06-5b40-48ea-8172-67fea9a77fa2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:32.844830 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-77b5cb06-5b40-48ea-8172-67fea9a77fa2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:32.845259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-77b5cb06-5b40-48ea-8172-67fea9a77fa2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:32.845936 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-77b5cb06-5b40-48ea-8172-67fea9a77fa2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:32.846409 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-77b5cb06-5b40-48ea-8172-67fea9a77fa2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:32.846827 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-77b5cb06-5b40-48ea-8172-67fea9a77fa2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:32.972449 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-374dfcce-0d24-4f32-9243-a400fc1a411d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:32.973113 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-374dfcce-0d24-4f32-9243-a400fc1a411d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:32.980169 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-374dfcce-0d24-4f32-9243-a400fc1a411d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:32.980702 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-374dfcce-0d24-4f32-9243-a400fc1a411d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:32.981228 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-374dfcce-0d24-4f32-9243-a400fc1a411d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:32.981954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-374dfcce-0d24-4f32-9243-a400fc1a411d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:32.982473 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-374dfcce-0d24-4f32-9243-a400fc1a411d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:32.983111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-374dfcce-0d24-4f32-9243-a400fc1a411d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:33.004520 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-77b5cb06-5b40-48ea-8172-67fea9a77fa2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:33.016015 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-77b5cb06-5b40-48ea-8172-67fea9a77fa2 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1722 microversion: 2.1 time: 0.183925 Sep 01 16:36:33.016643 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 192/402] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:32 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:33.135914 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-374dfcce-0d24-4f32-9243-a400fc1a411d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:33.144116 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-374dfcce-0d24-4f32-9243-a400fc1a411d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1319 microversion: 2.1 time: 0.176531 Sep 01 16:36:33.144690 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 211/403] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:32 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:33.598147 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-aa41aef3-e3b1-4e40-ac62-8ecfe264075b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:33.599543 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-aa41aef3-e3b1-4e40-ac62-8ecfe264075b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:33.607146 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-aa41aef3-e3b1-4e40-ac62-8ecfe264075b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:33.607628 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-aa41aef3-e3b1-4e40-ac62-8ecfe264075b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:33.608105 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-aa41aef3-e3b1-4e40-ac62-8ecfe264075b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:33.609261 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-aa41aef3-e3b1-4e40-ac62-8ecfe264075b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:33.609699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-aa41aef3-e3b1-4e40-ac62-8ecfe264075b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:33.610123 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-aa41aef3-e3b1-4e40-ac62-8ecfe264075b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:33.751263 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-aa41aef3-e3b1-4e40-ac62-8ecfe264075b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:33.770818 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-aa41aef3-e3b1-4e40-ac62-8ecfe264075b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1513 microversion: 2.1 time: 0.176903 Sep 01 16:36:33.778056 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 193/404] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:33 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:33.833667 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4a9c69ea-bbbe-468b-94d7-79a6ca8f212c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:33.837724 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4a9c69ea-bbbe-468b-94d7-79a6ca8f212c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:33.847870 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a9c69ea-bbbe-468b-94d7-79a6ca8f212c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:33.848271 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a9c69ea-bbbe-468b-94d7-79a6ca8f212c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:33.849056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a9c69ea-bbbe-468b-94d7-79a6ca8f212c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:33.849986 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a9c69ea-bbbe-468b-94d7-79a6ca8f212c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:33.853262 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a9c69ea-bbbe-468b-94d7-79a6ca8f212c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:33.853716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a9c69ea-bbbe-468b-94d7-79a6ca8f212c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:34.025540 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4a9c69ea-bbbe-468b-94d7-79a6ca8f212c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:34.042491 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7ee5ee89-3ce6-4a30-8e0a-829a6db84c43 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:34.043305 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7ee5ee89-3ce6-4a30-8e0a-829a6db84c43 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:34.053364 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4a9c69ea-bbbe-468b-94d7-79a6ca8f212c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:34.070973 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4a9c69ea-bbbe-468b-94d7-79a6ca8f212c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:34.072189 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4a9c69ea-bbbe-468b-94d7-79a6ca8f212c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.242743 Sep 01 16:36:34.072881 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7ee5ee89-3ce6-4a30-8e0a-829a6db84c43 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:34.073245 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7ee5ee89-3ce6-4a30-8e0a-829a6db84c43 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:34.074149 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7ee5ee89-3ce6-4a30-8e0a-829a6db84c43 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:34.075173 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7ee5ee89-3ce6-4a30-8e0a-829a6db84c43 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:34.077406 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7ee5ee89-3ce6-4a30-8e0a-829a6db84c43 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:34.077571 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 212/405] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:33 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:34.078505 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7ee5ee89-3ce6-4a30-8e0a-829a6db84c43 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:34.163908 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dbda0bd4-b80c-419f-8f93-97bc48dcfb66 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:34.164508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-dbda0bd4-b80c-419f-8f93-97bc48dcfb66 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:34.174391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dbda0bd4-b80c-419f-8f93-97bc48dcfb66 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:34.175455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dbda0bd4-b80c-419f-8f93-97bc48dcfb66 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:34.176753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dbda0bd4-b80c-419f-8f93-97bc48dcfb66 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:34.182511 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dbda0bd4-b80c-419f-8f93-97bc48dcfb66 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:34.183213 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dbda0bd4-b80c-419f-8f93-97bc48dcfb66 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:34.183823 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dbda0bd4-b80c-419f-8f93-97bc48dcfb66 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:34.294172 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-7ee5ee89-3ce6-4a30-8e0a-829a6db84c43 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:34.298036 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=100 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:34.304299 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7ee5ee89-3ce6-4a30-8e0a-829a6db84c43 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1722 microversion: 2.1 time: 0.267062 Sep 01 16:36:34.312987 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 194/406] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:34 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:34.368727 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dbda0bd4-b80c-419f-8f93-97bc48dcfb66 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:34.376423 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-dbda0bd4-b80c-419f-8f93-97bc48dcfb66 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1319 microversion: 2.1 time: 0.216987 Sep 01 16:36:34.376982 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 213/407] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:34 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:34.657427 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-7b3e6300-ded4-464f-bc5e-86196a8013e0 req-ade4cd51-a95a-4442-b282-ff784d99d257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa20f73-9965-4f95-b7a9-7d98e3822024", "name": "network-vif-plugged", "status": "completed", "tag": "896672fd-654c-408f-bad2-1993fb22ba9a"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:34.662815 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:34.667923 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-7b3e6300-ded4-464f-bc5e-86196a8013e0 req-ade4cd51-a95a-4442-b282-ff784d99d257 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:34.668570 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-7b3e6300-ded4-464f-bc5e-86196a8013e0 req-ade4cd51-a95a-4442-b282-ff784d99d257 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:34.668995 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-7b3e6300-ded4-464f-bc5e-86196a8013e0 req-ade4cd51-a95a-4442-b282-ff784d99d257 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:34.681911 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-7b3e6300-ded4-464f-bc5e-86196a8013e0 req-ade4cd51-a95a-4442-b282-ff784d99d257 service nova] Creating event network-vif-plugged:896672fd-654c-408f-bad2-1993fb22ba9a for instance 1fa20f73-9965-4f95-b7a9-7d98e3822024 on hv-cinder-85220 Sep 01 16:36:34.686634 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-7b3e6300-ded4-464f-bc5e-86196a8013e0 req-ade4cd51-a95a-4442-b282-ff784d99d257 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033481 Sep 01 16:36:34.687384 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 195/408] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:35.107939 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4c1e28d9-0b9e-4755-bf8a-e9d067438082 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:35.108576 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4c1e28d9-0b9e-4755-bf8a-e9d067438082 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:35.115022 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c1e28d9-0b9e-4755-bf8a-e9d067438082 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:35.116093 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c1e28d9-0b9e-4755-bf8a-e9d067438082 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:35.116529 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c1e28d9-0b9e-4755-bf8a-e9d067438082 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:35.117216 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c1e28d9-0b9e-4755-bf8a-e9d067438082 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:35.117662 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c1e28d9-0b9e-4755-bf8a-e9d067438082 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:35.118076 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c1e28d9-0b9e-4755-bf8a-e9d067438082 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:35.262861 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4c1e28d9-0b9e-4755-bf8a-e9d067438082 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:35.273813 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4c1e28d9-0b9e-4755-bf8a-e9d067438082 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:35.276893 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4c1e28d9-0b9e-4755-bf8a-e9d067438082 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:35.278734 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4c1e28d9-0b9e-4755-bf8a-e9d067438082 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.174709 Sep 01 16:36:35.279650 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 214/409] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:35 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:35.326418 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ed739b9a-5adc-437e-93b6-b0db8a7d6af0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:35.327112 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ed739b9a-5adc-437e-93b6-b0db8a7d6af0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:35.333901 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8374b28a-7cb5-4325-b282-f65d510d8062 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Action: 'create', calling method: .version_select at 0x7feeec2b8820>, body: {"keypair": {"name": "tempest-keypair-165001982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaD4JrYtgd0ohI/axw5uIb1A5kGDmtzUvVznL+USipq6AK+AxxLuix1GKoGuAk/ZH/gxqm2nG8Nv9GEeY9LcPkx/RAZeX5DnQmj5CgGwe9jNry7lNcKf0tjUsqfIhzrxg=="}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:35.334966 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed739b9a-5adc-437e-93b6-b0db8a7d6af0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:35.335619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed739b9a-5adc-437e-93b6-b0db8a7d6af0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:35.336041 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed739b9a-5adc-437e-93b6-b0db8a7d6af0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:35.336877 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed739b9a-5adc-437e-93b6-b0db8a7d6af0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:35.337536 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed739b9a-5adc-437e-93b6-b0db8a7d6af0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:35.338321 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed739b9a-5adc-437e-93b6-b0db8a7d6af0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:35.353037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-8374b28a-7cb5-4325-b282-f65d510d8062 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Getting quotas for project b4bbb5d3895c49fa8695d3bca946dbea. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:36:35.357413 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-8374b28a-7cb5-4325-b282-f65d510d8062 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Getting quotas for user 8020db56bca04d61b5a6e40384c25715 and project b4bbb5d3895c49fa8695d3bca946dbea. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:36:35.385043 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8374b28a-7cb5-4325-b282-f65d510d8062 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054916 Sep 01 16:36:35.385644 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 215/410] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 1 16:36:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:36:35.407282 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a802ec29-98a6-448f-8c57-5d2c833af162 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:35.407895 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a802ec29-98a6-448f-8c57-5d2c833af162 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:35.420798 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a802ec29-98a6-448f-8c57-5d2c833af162 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:35.421284 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a802ec29-98a6-448f-8c57-5d2c833af162 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:35.421757 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a802ec29-98a6-448f-8c57-5d2c833af162 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:35.422441 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a802ec29-98a6-448f-8c57-5d2c833af162 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:35.422914 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a802ec29-98a6-448f-8c57-5d2c833af162 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:35.423331 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a802ec29-98a6-448f-8c57-5d2c833af162 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:35.559377 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ed739b9a-5adc-437e-93b6-b0db8a7d6af0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:35.569399 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ed739b9a-5adc-437e-93b6-b0db8a7d6af0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1722 microversion: 2.1 time: 0.247665 Sep 01 16:36:35.570327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 196/411] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:35 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:35.634720 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a802ec29-98a6-448f-8c57-5d2c833af162 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:35.644358 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a802ec29-98a6-448f-8c57-5d2c833af162 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1319 microversion: 2.1 time: 0.244819 Sep 01 16:36:35.645276 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 216/412] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:35 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:36.304716 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-de114c04-1254-46b7-8827-bd8e6942c3ca tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:36.306006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-de114c04-1254-46b7-8827-bd8e6942c3ca tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:36.312738 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de114c04-1254-46b7-8827-bd8e6942c3ca tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:36.313567 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de114c04-1254-46b7-8827-bd8e6942c3ca tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:36.313993 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de114c04-1254-46b7-8827-bd8e6942c3ca tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:36.315655 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de114c04-1254-46b7-8827-bd8e6942c3ca tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:36.316250 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de114c04-1254-46b7-8827-bd8e6942c3ca tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:36.316826 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-de114c04-1254-46b7-8827-bd8e6942c3ca tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:36.505577 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-de114c04-1254-46b7-8827-bd8e6942c3ca tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:36.515778 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-de114c04-1254-46b7-8827-bd8e6942c3ca tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:36.517465 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-de114c04-1254-46b7-8827-bd8e6942c3ca tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:36.518850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-de114c04-1254-46b7-8827-bd8e6942c3ca tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.218878 Sep 01 16:36:36.519547 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 197/413] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:36 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:36.592186 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f9b811e2-e834-4027-9c19-21a59f441f9f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:36.593545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f9b811e2-e834-4027-9c19-21a59f441f9f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:36.603060 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9b811e2-e834-4027-9c19-21a59f441f9f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:36.603926 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9b811e2-e834-4027-9c19-21a59f441f9f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:36.604600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9b811e2-e834-4027-9c19-21a59f441f9f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:36.605463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9b811e2-e834-4027-9c19-21a59f441f9f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:36.605991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9b811e2-e834-4027-9c19-21a59f441f9f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:36.606801 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9b811e2-e834-4027-9c19-21a59f441f9f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:36.678726 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-424f47b6-79e2-4107-9bd8-3720f6f28d42 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:36.679496 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-424f47b6-79e2-4107-9bd8-3720f6f28d42 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:36.689532 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-424f47b6-79e2-4107-9bd8-3720f6f28d42 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:36.690182 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-424f47b6-79e2-4107-9bd8-3720f6f28d42 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:36.691112 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-424f47b6-79e2-4107-9bd8-3720f6f28d42 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:36.692430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-424f47b6-79e2-4107-9bd8-3720f6f28d42 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:36.693103 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-424f47b6-79e2-4107-9bd8-3720f6f28d42 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:36.694113 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-424f47b6-79e2-4107-9bd8-3720f6f28d42 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:36.984367 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-424f47b6-79e2-4107-9bd8-3720f6f28d42 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:36.995803 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-424f47b6-79e2-4107-9bd8-3720f6f28d42 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1319 microversion: 2.1 time: 0.321270 Sep 01 16:36:36.996400 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 198/414] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:36 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:37.046722 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f9b811e2-e834-4027-9c19-21a59f441f9f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:37.059946 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f9b811e2-e834-4027-9c19-21a59f441f9f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1722 microversion: 2.1 time: 0.471727 Sep 01 16:36:37.061016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 217/415] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:36 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1722 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:37.481320 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-751099231", "imageRef": "46185d58-0d47-4c97-b590-0f4434aa5c9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8d9b7d6-ff49-44c9-b2ab-e77725fc0de7"}], "security_groups": [{"name": "tempest-securitygroup--1832224958"}], "key_name": "tempest-keypair-165001982", "user_data": "}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:37.545065 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ca8495d9-fc78-41eb-b3ea-00319efdcc05 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:37.545678 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ca8495d9-fc78-41eb-b3ea-00319efdcc05 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:37.551876 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca8495d9-fc78-41eb-b3ea-00319efdcc05 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:37.552634 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca8495d9-fc78-41eb-b3ea-00319efdcc05 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:37.553776 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca8495d9-fc78-41eb-b3ea-00319efdcc05 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:37.554500 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca8495d9-fc78-41eb-b3ea-00319efdcc05 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:37.554953 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca8495d9-fc78-41eb-b3ea-00319efdcc05 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:37.555379 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca8495d9-fc78-41eb-b3ea-00319efdcc05 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:37.715678 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ca8495d9-fc78-41eb-b3ea-00319efdcc05 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:37.726286 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ca8495d9-fc78-41eb-b3ea-00319efdcc05 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:37.728247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ca8495d9-fc78-41eb-b3ea-00319efdcc05 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:37.729407 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ca8495d9-fc78-41eb-b3ea-00319efdcc05 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.188487 Sep 01 16:36:37.729947 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 218/416] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:37 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:36:38.017499 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d47595a5-2d2a-4d0e-b10d-979406844a9b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:38.018094 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d47595a5-2d2a-4d0e-b10d-979406844a9b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:38.025376 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d47595a5-2d2a-4d0e-b10d-979406844a9b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:38.025919 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d47595a5-2d2a-4d0e-b10d-979406844a9b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:38.026398 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d47595a5-2d2a-4d0e-b10d-979406844a9b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:38.027144 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d47595a5-2d2a-4d0e-b10d-979406844a9b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:38.027779 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d47595a5-2d2a-4d0e-b10d-979406844a9b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:38.028223 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d47595a5-2d2a-4d0e-b10d-979406844a9b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:38.220071 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d47595a5-2d2a-4d0e-b10d-979406844a9b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:38.228280 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d47595a5-2d2a-4d0e-b10d-979406844a9b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1508 microversion: 2.1 time: 0.215294 Sep 01 16:36:38.244735 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 219/417] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:38 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:38.249888 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-26df51f5-92e7-438f-9e5b-ef03fa39c927 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:38.250749 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-26df51f5-92e7-438f-9e5b-ef03fa39c927 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:38.258127 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26df51f5-92e7-438f-9e5b-ef03fa39c927 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:38.258648 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26df51f5-92e7-438f-9e5b-ef03fa39c927 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:38.259310 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26df51f5-92e7-438f-9e5b-ef03fa39c927 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:38.260016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26df51f5-92e7-438f-9e5b-ef03fa39c927 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:38.260506 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26df51f5-92e7-438f-9e5b-ef03fa39c927 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:38.260945 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26df51f5-92e7-438f-9e5b-ef03fa39c927 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:38.402919 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-26df51f5-92e7-438f-9e5b-ef03fa39c927 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:38.406553 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:38.412731 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-26df51f5-92e7-438f-9e5b-ef03fa39c927 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1722 microversion: 2.1 time: 0.166735 Sep 01 16:36:38.413301 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 220/418] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:38 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:38.756751 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6779f9f1-ae3c-4ab8-a833-34ac5c116824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:38.758025 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6779f9f1-ae3c-4ab8-a833-34ac5c116824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:38.766730 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6779f9f1-ae3c-4ab8-a833-34ac5c116824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:38.767276 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6779f9f1-ae3c-4ab8-a833-34ac5c116824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:38.767924 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6779f9f1-ae3c-4ab8-a833-34ac5c116824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:38.768821 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6779f9f1-ae3c-4ab8-a833-34ac5c116824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:38.769278 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6779f9f1-ae3c-4ab8-a833-34ac5c116824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:38.769766 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6779f9f1-ae3c-4ab8-a833-34ac5c116824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:38.920598 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6779f9f1-ae3c-4ab8-a833-34ac5c116824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:38.929643 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6779f9f1-ae3c-4ab8-a833-34ac5c116824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:38.931208 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6779f9f1-ae3c-4ab8-a833-34ac5c116824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:38.932471 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6779f9f1-ae3c-4ab8-a833-34ac5c116824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.181596 Sep 01 16:36:38.933096 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 221/419] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:38 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:39.436462 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c43acd47-ff29-43e2-ab15-0d53fbfe504a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:39.437077 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c43acd47-ff29-43e2-ab15-0d53fbfe504a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:39.447262 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c43acd47-ff29-43e2-ab15-0d53fbfe504a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:39.448368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c43acd47-ff29-43e2-ab15-0d53fbfe504a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:39.448941 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c43acd47-ff29-43e2-ab15-0d53fbfe504a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:39.450601 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c43acd47-ff29-43e2-ab15-0d53fbfe504a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:39.452527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c43acd47-ff29-43e2-ab15-0d53fbfe504a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:39.453328 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c43acd47-ff29-43e2-ab15-0d53fbfe504a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:39.613065 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c43acd47-ff29-43e2-ab15-0d53fbfe504a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:39.625675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c43acd47-ff29-43e2-ab15-0d53fbfe504a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1699 microversion: 2.1 time: 0.193337 Sep 01 16:36:39.626873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 222/420] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:39 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1699 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:39.647763 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dd292c5b-278c-4da3-9799-eaa32af34d3d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:39.654652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd292c5b-278c-4da3-9799-eaa32af34d3d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:39.655377 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd292c5b-278c-4da3-9799-eaa32af34d3d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:39.656029 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd292c5b-278c-4da3-9799-eaa32af34d3d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:39.728534 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-dd292c5b-278c-4da3-9799-eaa32af34d3d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Going to try to start instance {{(pid=127177) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 16:36:39.781873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-dd292c5b-278c-4da3-9799-eaa32af34d3d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "POST /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/action" status: 202 len: 0 microversion: 2.1 time: 0.137757 Sep 01 16:36:39.783510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 223/421] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 1 16:36:39 2022] POST /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:36:39.794059 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7ec218fa-4110-4b69-a88f-004e9c389213 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:39.796995 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7ec218fa-4110-4b69-a88f-004e9c389213 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:39.806202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ec218fa-4110-4b69-a88f-004e9c389213 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:39.807183 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ec218fa-4110-4b69-a88f-004e9c389213 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:39.807844 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ec218fa-4110-4b69-a88f-004e9c389213 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:39.808787 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ec218fa-4110-4b69-a88f-004e9c389213 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:39.809481 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ec218fa-4110-4b69-a88f-004e9c389213 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:39.810169 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ec218fa-4110-4b69-a88f-004e9c389213 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:40.025288 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7ec218fa-4110-4b69-a88f-004e9c389213 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:40.052008 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7ec218fa-4110-4b69-a88f-004e9c389213 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1708 microversion: 2.1 time: 0.261501 Sep 01 16:36:40.052008 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 224/422] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:39 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1708 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:40.064090 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-275d32cc-78be-4abc-855d-170d1cb35947 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:40.064922 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-275d32cc-78be-4abc-855d-170d1cb35947 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:40.074994 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-275d32cc-78be-4abc-855d-170d1cb35947 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:40.075561 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-275d32cc-78be-4abc-855d-170d1cb35947 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:40.076043 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-275d32cc-78be-4abc-855d-170d1cb35947 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:40.076798 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-275d32cc-78be-4abc-855d-170d1cb35947 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:40.077353 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-275d32cc-78be-4abc-855d-170d1cb35947 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:40.077916 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-275d32cc-78be-4abc-855d-170d1cb35947 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:40.322653 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-275d32cc-78be-4abc-855d-170d1cb35947 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:40.332642 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-275d32cc-78be-4abc-855d-170d1cb35947 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:40.335852 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-275d32cc-78be-4abc-855d-170d1cb35947 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:40.340670 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-275d32cc-78be-4abc-855d-170d1cb35947 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.286081 Sep 01 16:36:40.341560 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 225/423] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:40 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:41.073854 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-37f7a981-cae9-4269-bfdf-7cda7c77e3dc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:41.083128 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-37f7a981-cae9-4269-bfdf-7cda7c77e3dc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:41.096252 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-37f7a981-cae9-4269-bfdf-7cda7c77e3dc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:41.096971 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-37f7a981-cae9-4269-bfdf-7cda7c77e3dc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:41.097607 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-37f7a981-cae9-4269-bfdf-7cda7c77e3dc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:41.098513 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-37f7a981-cae9-4269-bfdf-7cda7c77e3dc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:41.099169 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-37f7a981-cae9-4269-bfdf-7cda7c77e3dc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:41.099797 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-37f7a981-cae9-4269-bfdf-7cda7c77e3dc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:41.259377 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-37f7a981-cae9-4269-bfdf-7cda7c77e3dc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:41.274571 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-37f7a981-cae9-4269-bfdf-7cda7c77e3dc tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1708 microversion: 2.1 time: 0.204585 Sep 01 16:36:41.275405 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 226/424] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:41 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1708 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:41.366959 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3b68c314-f374-4687-a1fc-920ce5658953 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:41.369336 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3b68c314-f374-4687-a1fc-920ce5658953 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:41.378521 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3b68c314-f374-4687-a1fc-920ce5658953 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:41.379008 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3b68c314-f374-4687-a1fc-920ce5658953 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:41.379738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3b68c314-f374-4687-a1fc-920ce5658953 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:41.380443 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3b68c314-f374-4687-a1fc-920ce5658953 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:41.381508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3b68c314-f374-4687-a1fc-920ce5658953 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:41.381970 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3b68c314-f374-4687-a1fc-920ce5658953 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:41.571436 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3b68c314-f374-4687-a1fc-920ce5658953 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:41.591414 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3b68c314-f374-4687-a1fc-920ce5658953 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:41.595231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3b68c314-f374-4687-a1fc-920ce5658953 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:41.597406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3b68c314-f374-4687-a1fc-920ce5658953 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.235785 Sep 01 16:36:41.598488 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 227/425] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:41 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:42.297025 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-11ec437c-725c-46f5-aa04-006004bfe563 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:42.297705 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-11ec437c-725c-46f5-aa04-006004bfe563 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:42.304150 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-11ec437c-725c-46f5-aa04-006004bfe563 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:42.304627 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-11ec437c-725c-46f5-aa04-006004bfe563 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:42.305080 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-11ec437c-725c-46f5-aa04-006004bfe563 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:42.305767 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-11ec437c-725c-46f5-aa04-006004bfe563 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:42.306216 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-11ec437c-725c-46f5-aa04-006004bfe563 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:42.306656 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-11ec437c-725c-46f5-aa04-006004bfe563 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:42.466067 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-11ec437c-725c-46f5-aa04-006004bfe563 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:42.476645 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-11ec437c-725c-46f5-aa04-006004bfe563 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1708 microversion: 2.1 time: 0.183460 Sep 01 16:36:42.477959 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 228/426] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:42 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1708 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:42.621694 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d20e4c1c-b468-41cb-99aa-56694ca7afc0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:42.622458 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d20e4c1c-b468-41cb-99aa-56694ca7afc0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:42.628508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d20e4c1c-b468-41cb-99aa-56694ca7afc0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:42.629090 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d20e4c1c-b468-41cb-99aa-56694ca7afc0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:42.629917 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d20e4c1c-b468-41cb-99aa-56694ca7afc0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:42.632029 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d20e4c1c-b468-41cb-99aa-56694ca7afc0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:42.632505 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d20e4c1c-b468-41cb-99aa-56694ca7afc0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:42.633137 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d20e4c1c-b468-41cb-99aa-56694ca7afc0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:42.786336 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d20e4c1c-b468-41cb-99aa-56694ca7afc0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:42.798569 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d20e4c1c-b468-41cb-99aa-56694ca7afc0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:42.800248 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d20e4c1c-b468-41cb-99aa-56694ca7afc0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:42.801558 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d20e4c1c-b468-41cb-99aa-56694ca7afc0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.184097 Sep 01 16:36:42.802307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 229/427] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:42 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:36:42.999313 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1691391126", "imageRef": "46185d58-0d47-4c97-b590-0f4434aa5c9e", "flavorRef": "452"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:43.177412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] validate_networks() for None {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:36:43.219159 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.network.neutron [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] validate_networks() for [('f8d9b7d6-ff49-44c9-b2ab-e77725fc0de7', None, None, None, None, None)] {{(pid=127178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:36:43.512846 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:36:43.513829 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:36:43.514478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:36:43.515047 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:36:43.515671 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:36:43.527554 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:43.529523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:43.530218 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:43.532262 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:43.533382 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:43.533899 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:43.562564 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Getting quotas for project 6536d1bc0651452092114f0a0650583e. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:36:43.571974 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Getting quotas for user f7f1c977d036430683b22364ab454102 and project 6536d1bc0651452092114f0a0650583e. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:36:43.590089 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:36:43.594040 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46185d58-0d47-4c97-b590-0f4434aa5c9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:36:43.682145 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-48b52a09-8aef-4dfe-a144-e68a9a327074 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686519 Sep 01 16:36:43.689544 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 230/428] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:36:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:36:43.694504 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-05cbb455-de99-4ad2-91f0-377fa886294c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:43.695117 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-05cbb455-de99-4ad2-91f0-377fa886294c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:43.704305 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05cbb455-de99-4ad2-91f0-377fa886294c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:43.705010 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05cbb455-de99-4ad2-91f0-377fa886294c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:43.705918 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05cbb455-de99-4ad2-91f0-377fa886294c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:43.707646 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05cbb455-de99-4ad2-91f0-377fa886294c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:43.708460 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05cbb455-de99-4ad2-91f0-377fa886294c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:43.710534 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05cbb455-de99-4ad2-91f0-377fa886294c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:43.732962 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Flavor limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:36:43.733386 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Image limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:36:43.733855 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Flavor pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:36:43.734296 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Image pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:36:43.734705 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:36:43.765352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:43.769299 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:43.772579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:43.777306 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:43.783346 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:43.783797 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:43.845144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Getting quotas for project b4bbb5d3895c49fa8695d3bca946dbea. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:36:43.865856 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Getting quotas for user 8020db56bca04d61b5a6e40384c25715 and project b4bbb5d3895c49fa8695d3bca946dbea. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:36:43.883309 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Going to run 1 instances... {{(pid=127178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:36:43.887183 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46185d58-0d47-4c97-b590-0f4434aa5c9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:36:43.950546 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-05cbb455-de99-4ad2-91f0-377fa886294c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:43.965369 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-05cbb455-de99-4ad2-91f0-377fa886294c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1712 microversion: 2.1 time: 0.274575 Sep 01 16:36:43.966592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 231/429] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:43 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1712 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:43.971673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5ac0ae6a-7546-42e1-90bd-1d63beada8a2 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:43.972489 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5ac0ae6a-7546-42e1-90bd-1d63beada8a2 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:43.985543 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-bf5b4aa0-35ec-4cf3-9518-03b69ab6178e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 6.508675 Sep 01 16:36:43.986556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 199/430] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:36:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 6510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 16:36:43.991410 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-5d81780b-48e6-4fef-a8a2-a797f9446674 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:43.992014 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-5d81780b-48e6-4fef-a8a2-a797f9446674 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:43.998845 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5d81780b-48e6-4fef-a8a2-a797f9446674 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:43.999608 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5d81780b-48e6-4fef-a8a2-a797f9446674 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:44.000193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5d81780b-48e6-4fef-a8a2-a797f9446674 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:44.001048 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5d81780b-48e6-4fef-a8a2-a797f9446674 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:44.001657 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5d81780b-48e6-4fef-a8a2-a797f9446674 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:44.002223 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5d81780b-48e6-4fef-a8a2-a797f9446674 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:44.061424 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5ac0ae6a-7546-42e1-90bd-1d63beada8a2 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:44.073303 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5ac0ae6a-7546-42e1-90bd-1d63beada8a2 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1215 microversion: 2.1 time: 0.105326 Sep 01 16:36:44.077751 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 232/431] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:43 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1215 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:44.092739 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-84e51131-8c35-4a2a-b329-8894f7056f90 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:44.093260 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-84e51131-8c35-4a2a-b329-8894f7056f90 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:44.157650 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-84e51131-8c35-4a2a-b329-8894f7056f90 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:44.170160 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-84e51131-8c35-4a2a-b329-8894f7056f90 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1244 microversion: 2.1 time: 0.091283 Sep 01 16:36:44.171469 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 233/432] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:44 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:44.322282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-5d81780b-48e6-4fef-a8a2-a797f9446674 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:44.335618 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-5d81780b-48e6-4fef-a8a2-a797f9446674 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:44.336999 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-5d81780b-48e6-4fef-a8a2-a797f9446674 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:44.338177 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-5d81780b-48e6-4fef-a8a2-a797f9446674 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.350668 Sep 01 16:36:44.342646 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 200/433] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:43 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:45.098881 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ee0fe39a-d9b4-421a-9804-7db1df7a0b13 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:45.099540 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ee0fe39a-d9b4-421a-9804-7db1df7a0b13 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:45.120930 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee0fe39a-d9b4-421a-9804-7db1df7a0b13 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:45.131683 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee0fe39a-d9b4-421a-9804-7db1df7a0b13 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:45.132542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee0fe39a-d9b4-421a-9804-7db1df7a0b13 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:45.134023 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee0fe39a-d9b4-421a-9804-7db1df7a0b13 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:45.134686 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee0fe39a-d9b4-421a-9804-7db1df7a0b13 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:45.135287 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee0fe39a-d9b4-421a-9804-7db1df7a0b13 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:45.192705 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-48d91c6a-6bce-4689-808e-d03e75cb3684 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:45.194368 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-48d91c6a-6bce-4689-808e-d03e75cb3684 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:45.206573 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48d91c6a-6bce-4689-808e-d03e75cb3684 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:45.213865 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48d91c6a-6bce-4689-808e-d03e75cb3684 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:45.214615 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48d91c6a-6bce-4689-808e-d03e75cb3684 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:45.215670 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48d91c6a-6bce-4689-808e-d03e75cb3684 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:45.217432 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48d91c6a-6bce-4689-808e-d03e75cb3684 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:45.223932 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48d91c6a-6bce-4689-808e-d03e75cb3684 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:45.322413 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-48d91c6a-6bce-4689-808e-d03e75cb3684 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:45.334117 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-48d91c6a-6bce-4689-808e-d03e75cb3684 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1240 microversion: 2.1 time: 0.144573 Sep 01 16:36:45.334815 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 201/434] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:45 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1240 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:45.344577 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ee0fe39a-d9b4-421a-9804-7db1df7a0b13 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:45.368251 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-021b8943-d91e-443c-a358-3bace20417eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:45.370390 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-021b8943-d91e-443c-a358-3bace20417eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:45.373008 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ee0fe39a-d9b4-421a-9804-7db1df7a0b13 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1267 microversion: 2.1 time: 0.278047 Sep 01 16:36:45.375803 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 234/435] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:45 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1267 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:45.381701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-021b8943-d91e-443c-a358-3bace20417eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:45.391305 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-021b8943-d91e-443c-a358-3bace20417eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:45.392071 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-021b8943-d91e-443c-a358-3bace20417eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:45.392693 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-021b8943-d91e-443c-a358-3bace20417eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:45.395189 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-021b8943-d91e-443c-a358-3bace20417eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:45.395808 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-021b8943-d91e-443c-a358-3bace20417eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:45.605769 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-021b8943-d91e-443c-a358-3bace20417eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:45.626776 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-021b8943-d91e-443c-a358-3bace20417eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:45.628727 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-021b8943-d91e-443c-a358-3bace20417eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:45.630858 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-021b8943-d91e-443c-a358-3bace20417eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.271626 Sep 01 16:36:45.631688 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 202/436] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:45 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:46.356974 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3793414b-72cf-41a6-801e-d2545473355e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:46.367084 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3793414b-72cf-41a6-801e-d2545473355e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:46.381124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3793414b-72cf-41a6-801e-d2545473355e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:46.384745 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3793414b-72cf-41a6-801e-d2545473355e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:46.393756 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3793414b-72cf-41a6-801e-d2545473355e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:46.394958 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3793414b-72cf-41a6-801e-d2545473355e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:46.395952 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3793414b-72cf-41a6-801e-d2545473355e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:46.403296 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f28058b3-d9f1-48e9-835b-f79db8bfd32d tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:46.404702 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f28058b3-d9f1-48e9-835b-f79db8bfd32d tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:46.410820 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3793414b-72cf-41a6-801e-d2545473355e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:46.416924 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f28058b3-d9f1-48e9-835b-f79db8bfd32d tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:46.421865 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f28058b3-d9f1-48e9-835b-f79db8bfd32d tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:46.426128 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f28058b3-d9f1-48e9-835b-f79db8bfd32d tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:46.427351 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f28058b3-d9f1-48e9-835b-f79db8bfd32d tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:46.429808 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f28058b3-d9f1-48e9-835b-f79db8bfd32d tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:46.433889 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f28058b3-d9f1-48e9-835b-f79db8bfd32d tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:46.568639 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3793414b-72cf-41a6-801e-d2545473355e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:46.583391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3793414b-72cf-41a6-801e-d2545473355e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1296 microversion: 2.1 time: 0.230184 Sep 01 16:36:46.594629 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 235/437] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:46 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1296 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:46.656745 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bbb71cc2-824c-4d83-9097-05446b709c79 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:46.657726 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bbb71cc2-824c-4d83-9097-05446b709c79 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:46.668810 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f28058b3-d9f1-48e9-835b-f79db8bfd32d tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:46.674299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bbb71cc2-824c-4d83-9097-05446b709c79 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:46.684784 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f28058b3-d9f1-48e9-835b-f79db8bfd32d tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1275 microversion: 2.1 time: 0.285813 Sep 01 16:36:46.685812 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bbb71cc2-824c-4d83-9097-05446b709c79 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:46.687208 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bbb71cc2-824c-4d83-9097-05446b709c79 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:46.687690 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 203/438] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:46 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1275 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:46.688747 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bbb71cc2-824c-4d83-9097-05446b709c79 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:46.689419 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bbb71cc2-824c-4d83-9097-05446b709c79 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:46.690188 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bbb71cc2-824c-4d83-9097-05446b709c79 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:46.983606 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bbb71cc2-824c-4d83-9097-05446b709c79 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:46.996447 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bbb71cc2-824c-4d83-9097-05446b709c79 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:46.998318 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bbb71cc2-824c-4d83-9097-05446b709c79 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:46.999665 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bbb71cc2-824c-4d83-9097-05446b709c79 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.347606 Sep 01 16:36:47.006341 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 236/439] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:46 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:36:47.608418 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e38a4322-10b5-4d55-bd48-b6d6fb59d28f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:47.609168 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-e38a4322-10b5-4d55-bd48-b6d6fb59d28f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:47.623601 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e38a4322-10b5-4d55-bd48-b6d6fb59d28f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:47.634997 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e38a4322-10b5-4d55-bd48-b6d6fb59d28f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:47.635767 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e38a4322-10b5-4d55-bd48-b6d6fb59d28f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:47.636676 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e38a4322-10b5-4d55-bd48-b6d6fb59d28f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:47.637289 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e38a4322-10b5-4d55-bd48-b6d6fb59d28f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:47.637872 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e38a4322-10b5-4d55-bd48-b6d6fb59d28f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:47.714968 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b996de91-1ef8-4fd8-bd59-50bb260bc1ca tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:47.717078 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b996de91-1ef8-4fd8-bd59-50bb260bc1ca tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:47.725549 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:47.728568 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b996de91-1ef8-4fd8-bd59-50bb260bc1ca tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:47.729320 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b996de91-1ef8-4fd8-bd59-50bb260bc1ca tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:47.730023 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b996de91-1ef8-4fd8-bd59-50bb260bc1ca tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:47.731240 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b996de91-1ef8-4fd8-bd59-50bb260bc1ca tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:47.731963 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b996de91-1ef8-4fd8-bd59-50bb260bc1ca tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:47.732874 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b996de91-1ef8-4fd8-bd59-50bb260bc1ca tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:47.810647 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b996de91-1ef8-4fd8-bd59-50bb260bc1ca tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:47.822691 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b996de91-1ef8-4fd8-bd59-50bb260bc1ca tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1273 microversion: 2.1 time: 0.112388 Sep 01 16:36:47.823915 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 237/440] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:47 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1273 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:47.886669 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e38a4322-10b5-4d55-bd48-b6d6fb59d28f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:47.895623 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-e38a4322-10b5-4d55-bd48-b6d6fb59d28f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1302 microversion: 2.1 time: 0.291641 Sep 01 16:36:47.897492 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 204/441] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:47 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1302 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:48.023637 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bcc45ee2-1c91-4555-a300-9fd6e4ad0a12 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:48.024611 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bcc45ee2-1c91-4555-a300-9fd6e4ad0a12 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:48.034813 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcc45ee2-1c91-4555-a300-9fd6e4ad0a12 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:48.035966 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcc45ee2-1c91-4555-a300-9fd6e4ad0a12 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:48.037324 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcc45ee2-1c91-4555-a300-9fd6e4ad0a12 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:48.040743 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcc45ee2-1c91-4555-a300-9fd6e4ad0a12 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:48.042777 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcc45ee2-1c91-4555-a300-9fd6e4ad0a12 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:48.043375 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcc45ee2-1c91-4555-a300-9fd6e4ad0a12 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:48.433311 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bcc45ee2-1c91-4555-a300-9fd6e4ad0a12 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:48.440374 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bcc45ee2-1c91-4555-a300-9fd6e4ad0a12 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:48.444138 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bcc45ee2-1c91-4555-a300-9fd6e4ad0a12 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:48.448561 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bcc45ee2-1c91-4555-a300-9fd6e4ad0a12 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.428800 Sep 01 16:36:48.463098 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 238/442] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:48 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:48.852987 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-9870123e-7412-483b-897a-5d6a88d4d890 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:48.853605 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-9870123e-7412-483b-897a-5d6a88d4d890 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:48.862299 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9870123e-7412-483b-897a-5d6a88d4d890 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:48.862789 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9870123e-7412-483b-897a-5d6a88d4d890 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:48.863352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9870123e-7412-483b-897a-5d6a88d4d890 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:48.864162 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9870123e-7412-483b-897a-5d6a88d4d890 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:48.864786 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9870123e-7412-483b-897a-5d6a88d4d890 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:48.870686 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9870123e-7412-483b-897a-5d6a88d4d890 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:48.918674 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-096f683f-b319-40bb-8724-8d7b09172922 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:48.919442 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-096f683f-b319-40bb-8724-8d7b09172922 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:48.936908 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-096f683f-b319-40bb-8724-8d7b09172922 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:48.937404 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-096f683f-b319-40bb-8724-8d7b09172922 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:48.946265 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-096f683f-b319-40bb-8724-8d7b09172922 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:48.947278 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-096f683f-b319-40bb-8724-8d7b09172922 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:48.952968 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-096f683f-b319-40bb-8724-8d7b09172922 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:48.954259 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-096f683f-b319-40bb-8724-8d7b09172922 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:48.970416 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:49.056818 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-096f683f-b319-40bb-8724-8d7b09172922 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:49.066424 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-096f683f-b319-40bb-8724-8d7b09172922 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1302 microversion: 2.1 time: 0.151878 Sep 01 16:36:49.067063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 239/443] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:48 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1302 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:49.281999 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9870123e-7412-483b-897a-5d6a88d4d890 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:49.299737 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-9870123e-7412-483b-897a-5d6a88d4d890 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1315 microversion: 2.1 time: 0.451746 Sep 01 16:36:49.300707 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 205/444] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:48 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:49.478982 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dd3c4192-7f0f-48a3-9065-2ebb311ee7a9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:49.479614 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-dd3c4192-7f0f-48a3-9065-2ebb311ee7a9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:49.497468 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd3c4192-7f0f-48a3-9065-2ebb311ee7a9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:49.497964 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd3c4192-7f0f-48a3-9065-2ebb311ee7a9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:49.498435 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd3c4192-7f0f-48a3-9065-2ebb311ee7a9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:49.499129 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd3c4192-7f0f-48a3-9065-2ebb311ee7a9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:49.499576 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd3c4192-7f0f-48a3-9065-2ebb311ee7a9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:49.499990 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd3c4192-7f0f-48a3-9065-2ebb311ee7a9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:49.799354 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dd3c4192-7f0f-48a3-9065-2ebb311ee7a9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:49.811404 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dd3c4192-7f0f-48a3-9065-2ebb311ee7a9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:49.813656 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dd3c4192-7f0f-48a3-9065-2ebb311ee7a9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:49.814847 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-dd3c4192-7f0f-48a3-9065-2ebb311ee7a9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.341664 Sep 01 16:36:49.816039 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 240/445] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:49 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:50.097271 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-659ebf48-dfa8-4c58-9e2b-956e6d2a84fb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:50.098484 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-659ebf48-dfa8-4c58-9e2b-956e6d2a84fb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:50.109411 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-659ebf48-dfa8-4c58-9e2b-956e6d2a84fb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:50.110596 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-659ebf48-dfa8-4c58-9e2b-956e6d2a84fb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:50.111255 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-659ebf48-dfa8-4c58-9e2b-956e6d2a84fb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:50.118600 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-659ebf48-dfa8-4c58-9e2b-956e6d2a84fb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:50.121713 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-659ebf48-dfa8-4c58-9e2b-956e6d2a84fb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:50.122809 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-659ebf48-dfa8-4c58-9e2b-956e6d2a84fb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:50.323910 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9298a2ea-f70c-45c3-9273-064dfec43905 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:50.324428 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9298a2ea-f70c-45c3-9273-064dfec43905 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:50.331689 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9298a2ea-f70c-45c3-9273-064dfec43905 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:50.332740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9298a2ea-f70c-45c3-9273-064dfec43905 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:50.333478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9298a2ea-f70c-45c3-9273-064dfec43905 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:50.334557 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9298a2ea-f70c-45c3-9273-064dfec43905 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:50.335082 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9298a2ea-f70c-45c3-9273-064dfec43905 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:50.335725 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9298a2ea-f70c-45c3-9273-064dfec43905 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:50.488237 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-659ebf48-dfa8-4c58-9e2b-956e6d2a84fb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:50.515886 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-659ebf48-dfa8-4c58-9e2b-956e6d2a84fb tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1370 microversion: 2.1 time: 0.417897 Sep 01 16:36:50.530432 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 206/446] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:50 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1370 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:50.578259 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9298a2ea-f70c-45c3-9273-064dfec43905 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:50.589743 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9298a2ea-f70c-45c3-9273-064dfec43905 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1315 microversion: 2.1 time: 0.272427 Sep 01 16:36:50.603797 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 241/447] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:50 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:50.837962 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-3e90157f-2a6f-4fa0-abac-fe625efe35dd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:50.838752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-3e90157f-2a6f-4fa0-abac-fe625efe35dd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:50.854007 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e90157f-2a6f-4fa0-abac-fe625efe35dd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:50.854792 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e90157f-2a6f-4fa0-abac-fe625efe35dd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:50.855412 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e90157f-2a6f-4fa0-abac-fe625efe35dd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:50.856284 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e90157f-2a6f-4fa0-abac-fe625efe35dd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:50.856899 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e90157f-2a6f-4fa0-abac-fe625efe35dd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:50.857081 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-e744f7a7-5238-4e50-ad30-41aba993f6fd req-2399c3e1-d4e2-47e3-b623-12807eeeb1da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "071ec310-3768-40d1-88bf-8f8f8c3db14b", "tag": "d3d00636-e531-4056-9749-f5ddf6e5f7b2"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:50.864111 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e90157f-2a6f-4fa0-abac-fe625efe35dd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:50.874364 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e744f7a7-5238-4e50-ad30-41aba993f6fd req-2399c3e1-d4e2-47e3-b623-12807eeeb1da service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:50.875207 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e744f7a7-5238-4e50-ad30-41aba993f6fd req-2399c3e1-d4e2-47e3-b623-12807eeeb1da service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:50.875732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e744f7a7-5238-4e50-ad30-41aba993f6fd req-2399c3e1-d4e2-47e3-b623-12807eeeb1da service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:50.891277 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-e744f7a7-5238-4e50-ad30-41aba993f6fd req-2399c3e1-d4e2-47e3-b623-12807eeeb1da service nova] Creating event network-changed:d3d00636-e531-4056-9749-f5ddf6e5f7b2 for instance 071ec310-3768-40d1-88bf-8f8f8c3db14b on hv-cinder-85220 Sep 01 16:36:50.897547 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-e744f7a7-5238-4e50-ad30-41aba993f6fd req-2399c3e1-d4e2-47e3-b623-12807eeeb1da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045680 Sep 01 16:36:50.899120 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 242/448] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:36:51.289310 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-3e90157f-2a6f-4fa0-abac-fe625efe35dd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:51.316559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-3e90157f-2a6f-4fa0-abac-fe625efe35dd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:51.337290 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-3e90157f-2a6f-4fa0-abac-fe625efe35dd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:51.340777 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-3e90157f-2a6f-4fa0-abac-fe625efe35dd tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.506527 Sep 01 16:36:51.380121 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 207/449] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:50 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:51.539347 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b7d916e0-2ea4-4dcb-8f06-e7ec037dc34e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:51.541207 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b7d916e0-2ea4-4dcb-8f06-e7ec037dc34e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:51.555792 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7d916e0-2ea4-4dcb-8f06-e7ec037dc34e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:51.556532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7d916e0-2ea4-4dcb-8f06-e7ec037dc34e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:51.557152 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7d916e0-2ea4-4dcb-8f06-e7ec037dc34e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:51.557859 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7d916e0-2ea4-4dcb-8f06-e7ec037dc34e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:51.558333 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7d916e0-2ea4-4dcb-8f06-e7ec037dc34e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:51.570623 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7d916e0-2ea4-4dcb-8f06-e7ec037dc34e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:51.614958 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-32bae8ca-2169-48e3-a7ff-babf36772d44 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:51.615744 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-32bae8ca-2169-48e3-a7ff-babf36772d44 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:51.628493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32bae8ca-2169-48e3-a7ff-babf36772d44 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:51.629238 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32bae8ca-2169-48e3-a7ff-babf36772d44 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:51.631595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32bae8ca-2169-48e3-a7ff-babf36772d44 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:51.646029 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32bae8ca-2169-48e3-a7ff-babf36772d44 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:51.648229 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32bae8ca-2169-48e3-a7ff-babf36772d44 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:51.648724 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32bae8ca-2169-48e3-a7ff-babf36772d44 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:51.751937 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b7d916e0-2ea4-4dcb-8f06-e7ec037dc34e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:51.768843 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b7d916e0-2ea4-4dcb-8f06-e7ec037dc34e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1370 microversion: 2.1 time: 0.234272 Sep 01 16:36:51.769429 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 243/450] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:51 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:52.082496 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-32bae8ca-2169-48e3-a7ff-babf36772d44 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:52.095321 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-32bae8ca-2169-48e3-a7ff-babf36772d44 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1315 microversion: 2.1 time: 0.486582 Sep 01 16:36:52.095882 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 208/451] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:51 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:52.375104 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ed0dd517-6e20-4064-ae25-2347560a8e6e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:52.375735 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ed0dd517-6e20-4064-ae25-2347560a8e6e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:52.382469 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed0dd517-6e20-4064-ae25-2347560a8e6e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:52.382958 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed0dd517-6e20-4064-ae25-2347560a8e6e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:52.383387 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed0dd517-6e20-4064-ae25-2347560a8e6e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:52.384526 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed0dd517-6e20-4064-ae25-2347560a8e6e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:52.384526 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed0dd517-6e20-4064-ae25-2347560a8e6e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:52.384959 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed0dd517-6e20-4064-ae25-2347560a8e6e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:52.563991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ed0dd517-6e20-4064-ae25-2347560a8e6e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:52.572889 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ed0dd517-6e20-4064-ae25-2347560a8e6e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:52.574508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ed0dd517-6e20-4064-ae25-2347560a8e6e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:52.576015 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ed0dd517-6e20-4064-ae25-2347560a8e6e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.205730 Sep 01 16:36:52.576813 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 244/452] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:52 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:52.794031 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-994d12fc-4f65-40c9-a6b2-e15ceea209bf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:52.795556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-994d12fc-4f65-40c9-a6b2-e15ceea209bf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:52.803041 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-994d12fc-4f65-40c9-a6b2-e15ceea209bf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:52.803785 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-994d12fc-4f65-40c9-a6b2-e15ceea209bf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:52.804298 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-994d12fc-4f65-40c9-a6b2-e15ceea209bf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:52.805027 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-994d12fc-4f65-40c9-a6b2-e15ceea209bf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:52.805476 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-994d12fc-4f65-40c9-a6b2-e15ceea209bf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:52.805898 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-994d12fc-4f65-40c9-a6b2-e15ceea209bf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:52.928794 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-849a8cc6-3b2b-4a62-a5dc-875b7a06381a req-e5dd4442-f1d9-45da-8668-74f8e853ba7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f1e8ce-fea9-426e-8ce0-23b9f7851b4e", "tag": "2b174a59-f0a9-4b1a-9233-ea65d28a5d38"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:52.946331 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-849a8cc6-3b2b-4a62-a5dc-875b7a06381a req-e5dd4442-f1d9-45da-8668-74f8e853ba7e service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:52.947201 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-849a8cc6-3b2b-4a62-a5dc-875b7a06381a req-e5dd4442-f1d9-45da-8668-74f8e853ba7e service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:52.948439 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-849a8cc6-3b2b-4a62-a5dc-875b7a06381a req-e5dd4442-f1d9-45da-8668-74f8e853ba7e service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:52.963370 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-994d12fc-4f65-40c9-a6b2-e15ceea209bf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:52.963613 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-849a8cc6-3b2b-4a62-a5dc-875b7a06381a req-e5dd4442-f1d9-45da-8668-74f8e853ba7e service nova] Creating event network-changed:2b174a59-f0a9-4b1a-9233-ea65d28a5d38 for instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e on hv-cinder-85220 Sep 01 16:36:52.972543 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-849a8cc6-3b2b-4a62-a5dc-875b7a06381a req-e5dd4442-f1d9-45da-8668-74f8e853ba7e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045567 Sep 01 16:36:52.973591 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-994d12fc-4f65-40c9-a6b2-e15ceea209bf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1370 microversion: 2.1 time: 0.184348 Sep 01 16:36:52.986260 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 209/453] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:52 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:52.986791 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 245/454] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:36:53.116694 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-eaaf7a5e-bf6f-4879-a672-ebd9fcf3d670 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:53.117740 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-eaaf7a5e-bf6f-4879-a672-ebd9fcf3d670 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:53.124450 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eaaf7a5e-bf6f-4879-a672-ebd9fcf3d670 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:53.124933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eaaf7a5e-bf6f-4879-a672-ebd9fcf3d670 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:53.125644 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eaaf7a5e-bf6f-4879-a672-ebd9fcf3d670 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:53.126586 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eaaf7a5e-bf6f-4879-a672-ebd9fcf3d670 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:53.127112 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eaaf7a5e-bf6f-4879-a672-ebd9fcf3d670 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:53.127610 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eaaf7a5e-bf6f-4879-a672-ebd9fcf3d670 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:53.297034 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-eaaf7a5e-bf6f-4879-a672-ebd9fcf3d670 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:53.314288 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-eaaf7a5e-bf6f-4879-a672-ebd9fcf3d670 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1315 microversion: 2.1 time: 0.201550 Sep 01 16:36:53.314881 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 210/455] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:53 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:53.607041 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-75b7102c-5710-4d4f-877b-441915da87e3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:53.607736 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-75b7102c-5710-4d4f-877b-441915da87e3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:53.611465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:53.618770 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-75b7102c-5710-4d4f-877b-441915da87e3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:53.619486 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-75b7102c-5710-4d4f-877b-441915da87e3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:53.619759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-75b7102c-5710-4d4f-877b-441915da87e3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:53.621603 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-75b7102c-5710-4d4f-877b-441915da87e3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:53.622367 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-75b7102c-5710-4d4f-877b-441915da87e3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:53.623014 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-75b7102c-5710-4d4f-877b-441915da87e3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:53.847936 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-75b7102c-5710-4d4f-877b-441915da87e3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:53.857812 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-75b7102c-5710-4d4f-877b-441915da87e3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:53.859311 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-75b7102c-5710-4d4f-877b-441915da87e3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:53.860815 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-75b7102c-5710-4d4f-877b-441915da87e3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.259401 Sep 01 16:36:53.862195 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 246/456] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:53 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:53.997619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d37c892f-5f9d-4990-bacb-d7747f791313 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:54.000315 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d37c892f-5f9d-4990-bacb-d7747f791313 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:54.003284 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:54.004052 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=6 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:54.012736 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d37c892f-5f9d-4990-bacb-d7747f791313 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.013459 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d37c892f-5f9d-4990-bacb-d7747f791313 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.014056 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d37c892f-5f9d-4990-bacb-d7747f791313 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.015573 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d37c892f-5f9d-4990-bacb-d7747f791313 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.016182 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d37c892f-5f9d-4990-bacb-d7747f791313 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.016895 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d37c892f-5f9d-4990-bacb-d7747f791313 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.182042 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d37c892f-5f9d-4990-bacb-d7747f791313 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:54.190373 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d37c892f-5f9d-4990-bacb-d7747f791313 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1370 microversion: 2.1 time: 0.197348 Sep 01 16:36:54.191035 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 211/457] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:53 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:54.332441 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=14 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:54.337444 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-fd4f467d-30d6-4e35-b30a-8df35e7fd805 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:54.338158 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-fd4f467d-30d6-4e35-b30a-8df35e7fd805 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:54.344840 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fd4f467d-30d6-4e35-b30a-8df35e7fd805 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.345356 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fd4f467d-30d6-4e35-b30a-8df35e7fd805 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.345762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fd4f467d-30d6-4e35-b30a-8df35e7fd805 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.346498 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fd4f467d-30d6-4e35-b30a-8df35e7fd805 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.346952 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fd4f467d-30d6-4e35-b30a-8df35e7fd805 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.347370 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fd4f467d-30d6-4e35-b30a-8df35e7fd805 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.514820 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-fd4f467d-30d6-4e35-b30a-8df35e7fd805 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:54.525453 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-fd4f467d-30d6-4e35-b30a-8df35e7fd805 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1315 microversion: 2.1 time: 0.193424 Sep 01 16:36:54.527409 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 247/458] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:54 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:54.902024 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c201ecd8-3d5a-403d-9c05-754cacc8668a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:54.902883 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c201ecd8-3d5a-403d-9c05-754cacc8668a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:54.911600 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c201ecd8-3d5a-403d-9c05-754cacc8668a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.912437 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c201ecd8-3d5a-403d-9c05-754cacc8668a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.913094 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c201ecd8-3d5a-403d-9c05-754cacc8668a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.914522 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c201ecd8-3d5a-403d-9c05-754cacc8668a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.915206 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c201ecd8-3d5a-403d-9c05-754cacc8668a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.915841 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c201ecd8-3d5a-403d-9c05-754cacc8668a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:55.109571 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c201ecd8-3d5a-403d-9c05-754cacc8668a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:55.113703 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=100 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:55.119819 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c201ecd8-3d5a-403d-9c05-754cacc8668a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:55.121296 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c201ecd8-3d5a-403d-9c05-754cacc8668a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:55.127730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c201ecd8-3d5a-403d-9c05-754cacc8668a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.235350 Sep 01 16:36:55.142263 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 212/459] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:54 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:36:55.212345 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-55d8c934-2516-4b87-adb9-fd70afd1621a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:55.212967 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-55d8c934-2516-4b87-adb9-fd70afd1621a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:55.219878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55d8c934-2516-4b87-adb9-fd70afd1621a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:55.220186 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55d8c934-2516-4b87-adb9-fd70afd1621a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:55.220617 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55d8c934-2516-4b87-adb9-fd70afd1621a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:55.221314 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55d8c934-2516-4b87-adb9-fd70afd1621a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:55.221946 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55d8c934-2516-4b87-adb9-fd70afd1621a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:55.222386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55d8c934-2516-4b87-adb9-fd70afd1621a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:55.395563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-55d8c934-2516-4b87-adb9-fd70afd1621a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:55.403943 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-55d8c934-2516-4b87-adb9-fd70afd1621a tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1370 microversion: 2.1 time: 0.195752 Sep 01 16:36:55.411415 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 248/460] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:55 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:55.555235 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-8085b876-fb40-402f-824c-bfaa6d298886 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:55.555829 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-8085b876-fb40-402f-824c-bfaa6d298886 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:55.562204 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8085b876-fb40-402f-824c-bfaa6d298886 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:55.562900 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8085b876-fb40-402f-824c-bfaa6d298886 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:55.563488 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8085b876-fb40-402f-824c-bfaa6d298886 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:55.565139 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8085b876-fb40-402f-824c-bfaa6d298886 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:55.565591 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8085b876-fb40-402f-824c-bfaa6d298886 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:55.566010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8085b876-fb40-402f-824c-bfaa6d298886 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:55.733680 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-8085b876-fb40-402f-824c-bfaa6d298886 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:55.746425 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-8085b876-fb40-402f-824c-bfaa6d298886 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1315 microversion: 2.1 time: 0.196682 Sep 01 16:36:55.747037 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 213/461] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:55 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:56.164517 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b748ca3e-0842-4b8f-aa3b-cf17f1e0f6aa tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:56.165351 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b748ca3e-0842-4b8f-aa3b-cf17f1e0f6aa tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:56.176450 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b748ca3e-0842-4b8f-aa3b-cf17f1e0f6aa tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.177216 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b748ca3e-0842-4b8f-aa3b-cf17f1e0f6aa tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.177920 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b748ca3e-0842-4b8f-aa3b-cf17f1e0f6aa tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.179067 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b748ca3e-0842-4b8f-aa3b-cf17f1e0f6aa tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.179818 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b748ca3e-0842-4b8f-aa3b-cf17f1e0f6aa tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.180603 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b748ca3e-0842-4b8f-aa3b-cf17f1e0f6aa tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.334870 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b748ca3e-0842-4b8f-aa3b-cf17f1e0f6aa tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:56.358376 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b748ca3e-0842-4b8f-aa3b-cf17f1e0f6aa tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:56.360304 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b748ca3e-0842-4b8f-aa3b-cf17f1e0f6aa tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:56.373217 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b748ca3e-0842-4b8f-aa3b-cf17f1e0f6aa tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.206837 Sep 01 16:36:56.374200 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 249/462] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:56 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:56.424909 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b82a6575-296a-421f-9690-0c083ea6058b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:56.425527 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b82a6575-296a-421f-9690-0c083ea6058b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:56.433403 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82a6575-296a-421f-9690-0c083ea6058b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.433889 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82a6575-296a-421f-9690-0c083ea6058b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.434552 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82a6575-296a-421f-9690-0c083ea6058b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.435288 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82a6575-296a-421f-9690-0c083ea6058b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.436091 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82a6575-296a-421f-9690-0c083ea6058b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.436682 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82a6575-296a-421f-9690-0c083ea6058b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.772018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-65e2a243-a837-44d3-ab3e-25bcefaca493 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:56.772628 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-65e2a243-a837-44d3-ab3e-25bcefaca493 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:56.781672 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-65e2a243-a837-44d3-ab3e-25bcefaca493 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.782337 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-65e2a243-a837-44d3-ab3e-25bcefaca493 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.782767 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-65e2a243-a837-44d3-ab3e-25bcefaca493 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.784129 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-65e2a243-a837-44d3-ab3e-25bcefaca493 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.784589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-65e2a243-a837-44d3-ab3e-25bcefaca493 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.785342 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-65e2a243-a837-44d3-ab3e-25bcefaca493 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.925534 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b82a6575-296a-421f-9690-0c083ea6058b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:56.938769 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b82a6575-296a-421f-9690-0c083ea6058b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1370 microversion: 2.1 time: 0.513270 Sep 01 16:36:56.939599 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 214/463] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:56 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1370 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:56.969778 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-65e2a243-a837-44d3-ab3e-25bcefaca493 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:56.979004 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-65e2a243-a837-44d3-ab3e-25bcefaca493 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1315 microversion: 2.1 time: 0.211261 Sep 01 16:36:56.989442 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 250/464] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:56 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:57.395827 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-90572776-3e8d-4a7f-95b2-43918494658d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:57.396449 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-90572776-3e8d-4a7f-95b2-43918494658d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:57.403151 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-90572776-3e8d-4a7f-95b2-43918494658d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:57.403631 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-90572776-3e8d-4a7f-95b2-43918494658d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:57.404056 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-90572776-3e8d-4a7f-95b2-43918494658d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:57.404729 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-90572776-3e8d-4a7f-95b2-43918494658d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:57.405171 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-90572776-3e8d-4a7f-95b2-43918494658d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:57.405586 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-90572776-3e8d-4a7f-95b2-43918494658d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:57.546932 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-90572776-3e8d-4a7f-95b2-43918494658d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:57.555608 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-90572776-3e8d-4a7f-95b2-43918494658d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:57.557059 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-90572776-3e8d-4a7f-95b2-43918494658d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:57.558259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-90572776-3e8d-4a7f-95b2-43918494658d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1738 microversion: 2.20 time: 0.166391 Sep 01 16:36:57.558802 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 215/465] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:57 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:57.959611 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-67eab7ce-8ba7-4180-80d2-6a625ffb0d5b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:57.960217 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-67eab7ce-8ba7-4180-80d2-6a625ffb0d5b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:57.966663 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-67eab7ce-8ba7-4180-80d2-6a625ffb0d5b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:57.967138 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-67eab7ce-8ba7-4180-80d2-6a625ffb0d5b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:57.967561 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-67eab7ce-8ba7-4180-80d2-6a625ffb0d5b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:57.968252 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-67eab7ce-8ba7-4180-80d2-6a625ffb0d5b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:57.968697 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-67eab7ce-8ba7-4180-80d2-6a625ffb0d5b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:57.969115 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-67eab7ce-8ba7-4180-80d2-6a625ffb0d5b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:58.001993 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-3308f537-118a-4059-984b-e577bcef69f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:58.002756 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-3308f537-118a-4059-984b-e577bcef69f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:58.009526 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3308f537-118a-4059-984b-e577bcef69f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:58.010015 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3308f537-118a-4059-984b-e577bcef69f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:58.011709 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3308f537-118a-4059-984b-e577bcef69f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:58.011709 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3308f537-118a-4059-984b-e577bcef69f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:58.011709 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3308f537-118a-4059-984b-e577bcef69f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:58.013218 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3308f537-118a-4059-984b-e577bcef69f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:58.149697 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-3308f537-118a-4059-984b-e577bcef69f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:58.157586 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-3308f537-118a-4059-984b-e577bcef69f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1315 microversion: 2.1 time: 0.159419 Sep 01 16:36:58.158165 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 216/466] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:57 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:58.205338 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-67eab7ce-8ba7-4180-80d2-6a625ffb0d5b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:58.213228 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-67eab7ce-8ba7-4180-80d2-6a625ffb0d5b tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1370 microversion: 2.1 time: 0.257471 Sep 01 16:36:58.217644 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 251/467] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:57 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1370 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:58.587176 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-80f8c0b4-3508-42a2-a6c5-93540fe14cd1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:58.588497 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-80f8c0b4-3508-42a2-a6c5-93540fe14cd1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:58.594851 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-80f8c0b4-3508-42a2-a6c5-93540fe14cd1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:58.595562 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-80f8c0b4-3508-42a2-a6c5-93540fe14cd1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:58.596218 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-80f8c0b4-3508-42a2-a6c5-93540fe14cd1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:58.597187 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-80f8c0b4-3508-42a2-a6c5-93540fe14cd1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:58.597877 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-80f8c0b4-3508-42a2-a6c5-93540fe14cd1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:58.598684 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-80f8c0b4-3508-42a2-a6c5-93540fe14cd1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:58.838290 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-3a69ab30-771b-4ca7-a4fb-16915a6c2cfc req-0d19337d-ab36-4ea0-bbe4-25c8b5d40401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "071ec310-3768-40d1-88bf-8f8f8c3db14b", "name": "network-vif-plugged", "status": "completed", "tag": "d3d00636-e531-4056-9749-f5ddf6e5f7b2"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:58.861102 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-3a69ab30-771b-4ca7-a4fb-16915a6c2cfc req-0d19337d-ab36-4ea0-bbe4-25c8b5d40401 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:58.862107 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-3a69ab30-771b-4ca7-a4fb-16915a6c2cfc req-0d19337d-ab36-4ea0-bbe4-25c8b5d40401 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:58.862913 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-3a69ab30-771b-4ca7-a4fb-16915a6c2cfc req-0d19337d-ab36-4ea0-bbe4-25c8b5d40401 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:58.901933 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-3a69ab30-771b-4ca7-a4fb-16915a6c2cfc req-0d19337d-ab36-4ea0-bbe4-25c8b5d40401 service nova] Creating event network-vif-plugged:d3d00636-e531-4056-9749-f5ddf6e5f7b2 for instance 071ec310-3768-40d1-88bf-8f8f8c3db14b on hv-cinder-85220 Sep 01 16:36:58.920065 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-3a69ab30-771b-4ca7-a4fb-16915a6c2cfc req-0d19337d-ab36-4ea0-bbe4-25c8b5d40401 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086340 Sep 01 16:36:58.926305 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 252/468] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:59.179164 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-80f8c0b4-3508-42a2-a6c5-93540fe14cd1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:59.181015 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5e5193c2-c455-4c53-a0f1-f5170796a8f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:59.182190 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5e5193c2-c455-4c53-a0f1-f5170796a8f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:59.188114 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-80f8c0b4-3508-42a2-a6c5-93540fe14cd1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:59.189596 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-80f8c0b4-3508-42a2-a6c5-93540fe14cd1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:59.190698 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e5193c2-c455-4c53-a0f1-f5170796a8f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:59.191350 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e5193c2-c455-4c53-a0f1-f5170796a8f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:59.191935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e5193c2-c455-4c53-a0f1-f5170796a8f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:59.193285 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e5193c2-c455-4c53-a0f1-f5170796a8f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:59.194477 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e5193c2-c455-4c53-a0f1-f5170796a8f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:59.195412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e5193c2-c455-4c53-a0f1-f5170796a8f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:59.204188 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-80f8c0b4-3508-42a2-a6c5-93540fe14cd1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1720 microversion: 2.20 time: 0.624322 Sep 01 16:36:59.205158 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 217/469] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:36:58 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1720 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:36:59.234172 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b965b904-6b41-47c6-a866-2d7d1836d54d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:59.235078 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b965b904-6b41-47c6-a866-2d7d1836d54d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:59.254628 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b965b904-6b41-47c6-a866-2d7d1836d54d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:59.255321 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b965b904-6b41-47c6-a866-2d7d1836d54d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:59.255970 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b965b904-6b41-47c6-a866-2d7d1836d54d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:59.258922 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b965b904-6b41-47c6-a866-2d7d1836d54d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:59.259635 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b965b904-6b41-47c6-a866-2d7d1836d54d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:59.260239 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b965b904-6b41-47c6-a866-2d7d1836d54d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:59.432123 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5e5193c2-c455-4c53-a0f1-f5170796a8f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:59.442462 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5e5193c2-c455-4c53-a0f1-f5170796a8f6 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1315 microversion: 2.1 time: 0.267226 Sep 01 16:36:59.445117 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 253/470] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:59 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:59.892025 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b965b904-6b41-47c6-a866-2d7d1836d54d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:59.899940 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b965b904-6b41-47c6-a866-2d7d1836d54d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1370 microversion: 2.1 time: 0.669559 Sep 01 16:36:59.900545 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 218/471] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:59 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1370 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:00.236272 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d81bbd2d-c77d-4591-87fa-71a81ba36e0c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:00.236868 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d81bbd2d-c77d-4591-87fa-71a81ba36e0c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:00.243295 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d81bbd2d-c77d-4591-87fa-71a81ba36e0c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.243767 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d81bbd2d-c77d-4591-87fa-71a81ba36e0c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.244192 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d81bbd2d-c77d-4591-87fa-71a81ba36e0c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:00.244868 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d81bbd2d-c77d-4591-87fa-71a81ba36e0c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.245307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d81bbd2d-c77d-4591-87fa-71a81ba36e0c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.245717 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d81bbd2d-c77d-4591-87fa-71a81ba36e0c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:00.378106 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d81bbd2d-c77d-4591-87fa-71a81ba36e0c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:00.386336 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d81bbd2d-c77d-4591-87fa-71a81ba36e0c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:00.387800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d81bbd2d-c77d-4591-87fa-71a81ba36e0c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:00.388944 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d81bbd2d-c77d-4591-87fa-71a81ba36e0c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1720 microversion: 2.20 time: 0.156553 Sep 01 16:37:00.389516 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 254/472] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:00 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:00.464933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e084798f-5490-4aed-8814-6360d410bdb5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:00.465780 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-e084798f-5490-4aed-8814-6360d410bdb5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:00.471920 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e084798f-5490-4aed-8814-6360d410bdb5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.472469 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e084798f-5490-4aed-8814-6360d410bdb5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.472895 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e084798f-5490-4aed-8814-6360d410bdb5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:00.473578 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e084798f-5490-4aed-8814-6360d410bdb5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.474014 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e084798f-5490-4aed-8814-6360d410bdb5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.474530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e084798f-5490-4aed-8814-6360d410bdb5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:00.645963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e084798f-5490-4aed-8814-6360d410bdb5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:00.654898 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-e084798f-5490-4aed-8814-6360d410bdb5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1315 microversion: 2.1 time: 0.193464 Sep 01 16:37:00.656379 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 219/473] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:00 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:00.921403 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-21ef8d33-66bc-4abe-b905-2023162f4fcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:00.922103 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-21ef8d33-66bc-4abe-b905-2023162f4fcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:00.929726 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21ef8d33-66bc-4abe-b905-2023162f4fcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.930503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21ef8d33-66bc-4abe-b905-2023162f4fcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.931137 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21ef8d33-66bc-4abe-b905-2023162f4fcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:00.932074 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21ef8d33-66bc-4abe-b905-2023162f4fcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.932728 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21ef8d33-66bc-4abe-b905-2023162f4fcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.933372 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21ef8d33-66bc-4abe-b905-2023162f4fcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:00.950776 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-20cab89b-c720-44ba-8de7-4df42a687d28 req-63c7b3a4-416b-4b06-8e09-cc7b8d09cda8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0958ba3f-7f1d-4fa1-bff7-4459d3945b6f", "name": "network-vif-unplugged", "status": "completed", "tag": "46daf8ff-8552-45e4-b4ac-b60b47e199de"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:00.972291 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-20cab89b-c720-44ba-8de7-4df42a687d28 req-63c7b3a4-416b-4b06-8e09-cc7b8d09cda8 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.972956 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-20cab89b-c720-44ba-8de7-4df42a687d28 req-63c7b3a4-416b-4b06-8e09-cc7b8d09cda8 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.974131 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-20cab89b-c720-44ba-8de7-4df42a687d28 req-63c7b3a4-416b-4b06-8e09-cc7b8d09cda8 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.009148 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-20cab89b-c720-44ba-8de7-4df42a687d28 req-63c7b3a4-416b-4b06-8e09-cc7b8d09cda8 service nova] Creating event network-vif-unplugged:46daf8ff-8552-45e4-b4ac-b60b47e199de for instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f on hv-cinder-85220 Sep 01 16:37:01.034498 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-20cab89b-c720-44ba-8de7-4df42a687d28 req-63c7b3a4-416b-4b06-8e09-cc7b8d09cda8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083334 Sep 01 16:37:01.039002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 220/474] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:01.172039 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-21ef8d33-66bc-4abe-b905-2023162f4fcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:01.182205 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-21ef8d33-66bc-4abe-b905-2023162f4fcc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1370 microversion: 2.1 time: 0.264643 Sep 01 16:37:01.194309 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 255/475] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:00 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1370 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:01.413668 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-412db1d2-370d-4ab4-ae19-f17de47fc9ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:01.414602 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-412db1d2-370d-4ab4-ae19-f17de47fc9ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:01.421161 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-412db1d2-370d-4ab4-ae19-f17de47fc9ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.422043 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-412db1d2-370d-4ab4-ae19-f17de47fc9ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.422493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-412db1d2-370d-4ab4-ae19-f17de47fc9ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.423375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-412db1d2-370d-4ab4-ae19-f17de47fc9ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.424016 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-412db1d2-370d-4ab4-ae19-f17de47fc9ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.424414 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-412db1d2-370d-4ab4-ae19-f17de47fc9ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.586744 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1065670319", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-346534431", "security_groups": [{"name": "tempest-secgroup-smoke-1444885176"}], "block_device_mapping_v2": [{"uuid": "c0d5f754-fc23-4943-8848-b6f691138e19", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5fae8c7f-11cf-4ab3-8c34-e624963abdb8"}]}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:01.625070 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-412db1d2-370d-4ab4-ae19-f17de47fc9ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:01.638053 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-412db1d2-370d-4ab4-ae19-f17de47fc9ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:01.640225 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-412db1d2-370d-4ab4-ae19-f17de47fc9ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:01.641909 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-412db1d2-370d-4ab4-ae19-f17de47fc9ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1720 microversion: 2.20 time: 0.233517 Sep 01 16:37:01.643062 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 221/476] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:01 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:01.680208 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b4aad26e-4304-4666-86cd-d02a8b7d50c2 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:01.680964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b4aad26e-4304-4666-86cd-d02a8b7d50c2 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:01.687692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b4aad26e-4304-4666-86cd-d02a8b7d50c2 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.688900 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b4aad26e-4304-4666-86cd-d02a8b7d50c2 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.689843 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b4aad26e-4304-4666-86cd-d02a8b7d50c2 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.690948 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b4aad26e-4304-4666-86cd-d02a8b7d50c2 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.691943 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b4aad26e-4304-4666-86cd-d02a8b7d50c2 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.692615 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b4aad26e-4304-4666-86cd-d02a8b7d50c2 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.743092 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] validate_networks() for [('5fae8c7f-11cf-4ab3-8c34-e624963abdb8', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:37:01.842984 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b4aad26e-4304-4666-86cd-d02a8b7d50c2 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:01.851486 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b4aad26e-4304-4666-86cd-d02a8b7d50c2 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1315 microversion: 2.1 time: 0.176271 Sep 01 16:37:01.864622 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 222/477] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:01 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:02.150931 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:37:02.151345 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:37:02.151803 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:37:02.152201 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:37:02.152599 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:37:02.161261 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:02.161728 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:02.162147 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:02.162923 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:02.163367 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:02.163778 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:02.179787 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Getting quotas for project 4b6bf55e6c5e47f3895e135c4d6dc3ff. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:37:02.183678 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Getting quotas for user a3059f5115bb4bad837daf9f18752143 and project 4b6bf55e6c5e47f3895e135c4d6dc3ff. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:37:02.203684 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-1907da5d-0d8c-4fd7-8a0e-449a4e3be0ba tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:02.204296 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-1907da5d-0d8c-4fd7-8a0e-449a4e3be0ba tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:02.211025 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1907da5d-0d8c-4fd7-8a0e-449a4e3be0ba tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:02.211504 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1907da5d-0d8c-4fd7-8a0e-449a4e3be0ba tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:02.211940 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1907da5d-0d8c-4fd7-8a0e-449a4e3be0ba tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:02.212629 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1907da5d-0d8c-4fd7-8a0e-449a4e3be0ba tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:02.213083 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1907da5d-0d8c-4fd7-8a0e-449a4e3be0ba tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:02.213525 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1907da5d-0d8c-4fd7-8a0e-449a4e3be0ba tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:02.244685 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:37:02.246954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c0d5f754-fc23-4943-8848-b6f691138e19',volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:37:02.354068 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-1907da5d-0d8c-4fd7-8a0e-449a4e3be0ba tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:02.363032 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-1907da5d-0d8c-4fd7-8a0e-449a4e3be0ba tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1370 microversion: 2.1 time: 0.163075 Sep 01 16:37:02.372404 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 223/478] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:02 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:02.391187 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-53f6fe71-c937-46b6-a097-3927f5706b74 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.809333 Sep 01 16:37:02.391856 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 256/479] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:37:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:37:02.403206 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c738a2cb-973a-45b6-a9b5-a45ee85af5e2 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:02.403813 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c738a2cb-973a-45b6-a9b5-a45ee85af5e2 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:02.457249 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c738a2cb-973a-45b6-a9b5-a45ee85af5e2 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:02.464759 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c738a2cb-973a-45b6-a9b5-a45ee85af5e2 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1094 microversion: 2.1 time: 0.065473 Sep 01 16:37:02.465328 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 224/480] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:02 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:02.670758 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a75a4790-b83b-4dfa-8a0d-7ab955a8aadc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:02.671690 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a75a4790-b83b-4dfa-8a0d-7ab955a8aadc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:02.679576 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a75a4790-b83b-4dfa-8a0d-7ab955a8aadc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:02.680063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a75a4790-b83b-4dfa-8a0d-7ab955a8aadc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:02.680498 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a75a4790-b83b-4dfa-8a0d-7ab955a8aadc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:02.681196 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a75a4790-b83b-4dfa-8a0d-7ab955a8aadc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:02.681649 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a75a4790-b83b-4dfa-8a0d-7ab955a8aadc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:02.682071 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a75a4790-b83b-4dfa-8a0d-7ab955a8aadc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:02.834047 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a75a4790-b83b-4dfa-8a0d-7ab955a8aadc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:02.842763 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a75a4790-b83b-4dfa-8a0d-7ab955a8aadc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:02.844209 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a75a4790-b83b-4dfa-8a0d-7ab955a8aadc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:02.845368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a75a4790-b83b-4dfa-8a0d-7ab955a8aadc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1720 microversion: 2.20 time: 0.180451 Sep 01 16:37:02.845963 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 257/481] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:02 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:02.872637 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-98909d92-00ac-4ddb-b712-610f577c9298 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:02.873166 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-98909d92-00ac-4ddb-b712-610f577c9298 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:02.880500 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-98909d92-00ac-4ddb-b712-610f577c9298 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:02.880985 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-98909d92-00ac-4ddb-b712-610f577c9298 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:02.881948 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-98909d92-00ac-4ddb-b712-610f577c9298 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:02.882851 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-98909d92-00ac-4ddb-b712-610f577c9298 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:02.883102 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-98909d92-00ac-4ddb-b712-610f577c9298 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:02.883513 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-98909d92-00ac-4ddb-b712-610f577c9298 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.019668 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-98909d92-00ac-4ddb-b712-610f577c9298 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:03.027988 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-98909d92-00ac-4ddb-b712-610f577c9298 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1465 microversion: 2.1 time: 0.159287 Sep 01 16:37:03.028409 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 225/482] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:02 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1465 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:03.066933 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-4bff9ab1-2270-4151-b423-f6b48c3c8749 req-028ab186-bdc8-4c0e-a50c-135b04e511c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f1e8ce-fea9-426e-8ce0-23b9f7851b4e", "name": "network-vif-plugged", "status": "completed", "tag": "2b174a59-f0a9-4b1a-9233-ea65d28a5d38"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:03.075765 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a630917a-a599-4c39-a97f-9527743d75c4 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:03.076376 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a630917a-a599-4c39-a97f-9527743d75c4 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:03.077130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-4bff9ab1-2270-4151-b423-f6b48c3c8749 req-028ab186-bdc8-4c0e-a50c-135b04e511c2 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.077771 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-4bff9ab1-2270-4151-b423-f6b48c3c8749 req-028ab186-bdc8-4c0e-a50c-135b04e511c2 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.078191 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-4bff9ab1-2270-4151-b423-f6b48c3c8749 req-028ab186-bdc8-4c0e-a50c-135b04e511c2 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.082463 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a630917a-a599-4c39-a97f-9527743d75c4 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.082942 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a630917a-a599-4c39-a97f-9527743d75c4 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.083375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a630917a-a599-4c39-a97f-9527743d75c4 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.084060 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a630917a-a599-4c39-a97f-9527743d75c4 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.084509 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a630917a-a599-4c39-a97f-9527743d75c4 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.084931 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a630917a-a599-4c39-a97f-9527743d75c4 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.088882 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-4bff9ab1-2270-4151-b423-f6b48c3c8749 req-028ab186-bdc8-4c0e-a50c-135b04e511c2 service nova] Creating event network-vif-plugged:2b174a59-f0a9-4b1a-9233-ea65d28a5d38 for instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e on hv-cinder-85220 Sep 01 16:37:03.093929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-4bff9ab1-2270-4151-b423-f6b48c3c8749 req-028ab186-bdc8-4c0e-a50c-135b04e511c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030554 Sep 01 16:37:03.094604 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 258/483] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:03.110638 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a630917a-a599-4c39-a97f-9527743d75c4 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Going to try to terminate instance {{(pid=127178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:37:03.189434 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a630917a-a599-4c39-a97f-9527743d75c4 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "DELETE /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 204 len: 0 microversion: 2.1 time: 0.117209 Sep 01 16:37:03.190016 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 226/484] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:37:03 2022] DELETE /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 16:37:03.199527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-20dbc230-f9b0-45b7-9d37-58832adfa1cd tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:03.200219 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-20dbc230-f9b0-45b7-9d37-58832adfa1cd tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:03.206319 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20dbc230-f9b0-45b7-9d37-58832adfa1cd tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.206793 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20dbc230-f9b0-45b7-9d37-58832adfa1cd tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.207266 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20dbc230-f9b0-45b7-9d37-58832adfa1cd tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.207936 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20dbc230-f9b0-45b7-9d37-58832adfa1cd tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.208378 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20dbc230-f9b0-45b7-9d37-58832adfa1cd tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.208835 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20dbc230-f9b0-45b7-9d37-58832adfa1cd tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.212823 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:03.342817 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-20dbc230-f9b0-45b7-9d37-58832adfa1cd tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:03.350446 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-20dbc230-f9b0-45b7-9d37-58832adfa1cd tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1471 microversion: 2.1 time: 0.155156 Sep 01 16:37:03.351235 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 259/485] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:03 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:03.386159 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-1b55e8eb-9f17-48f7-846e-d7a2607796ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:03.386897 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-1b55e8eb-9f17-48f7-846e-d7a2607796ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:03.392870 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b55e8eb-9f17-48f7-846e-d7a2607796ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.393364 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b55e8eb-9f17-48f7-846e-d7a2607796ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.393792 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b55e8eb-9f17-48f7-846e-d7a2607796ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.394510 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b55e8eb-9f17-48f7-846e-d7a2607796ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.394957 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b55e8eb-9f17-48f7-846e-d7a2607796ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.395406 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b55e8eb-9f17-48f7-846e-d7a2607796ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.485900 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a8ecd93d-0191-404c-aa6f-e53a2e9a0c96 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:03.486528 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a8ecd93d-0191-404c-aa6f-e53a2e9a0c96 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:03.492986 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a8ecd93d-0191-404c-aa6f-e53a2e9a0c96 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.493461 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a8ecd93d-0191-404c-aa6f-e53a2e9a0c96 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.493884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a8ecd93d-0191-404c-aa6f-e53a2e9a0c96 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.494607 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a8ecd93d-0191-404c-aa6f-e53a2e9a0c96 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.495053 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a8ecd93d-0191-404c-aa6f-e53a2e9a0c96 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.495464 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a8ecd93d-0191-404c-aa6f-e53a2e9a0c96 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.528198 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-1b55e8eb-9f17-48f7-846e-d7a2607796ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:03.539024 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-1b55e8eb-9f17-48f7-846e-d7a2607796ac tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1370 microversion: 2.1 time: 0.157611 Sep 01 16:37:03.539613 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 227/486] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:03 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:03.555951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a8ecd93d-0191-404c-aa6f-e53a2e9a0c96 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:03.563606 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a8ecd93d-0191-404c-aa6f-e53a2e9a0c96 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1144 microversion: 2.1 time: 0.081505 Sep 01 16:37:03.564155 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 260/487] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:03 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:03.868920 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-9b140f63-8f31-45d6-8b52-8744b517f6c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:03.869507 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-9b140f63-8f31-45d6-8b52-8744b517f6c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:03.875472 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9b140f63-8f31-45d6-8b52-8744b517f6c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.875942 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9b140f63-8f31-45d6-8b52-8744b517f6c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.876365 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9b140f63-8f31-45d6-8b52-8744b517f6c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.877036 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9b140f63-8f31-45d6-8b52-8744b517f6c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.877475 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9b140f63-8f31-45d6-8b52-8744b517f6c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.877884 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9b140f63-8f31-45d6-8b52-8744b517f6c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.013413 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9b140f63-8f31-45d6-8b52-8744b517f6c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:04.021914 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9b140f63-8f31-45d6-8b52-8744b517f6c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:04.023871 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9b140f63-8f31-45d6-8b52-8744b517f6c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:04.025010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-9b140f63-8f31-45d6-8b52-8744b517f6c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1720 microversion: 2.20 time: 0.160029 Sep 01 16:37:04.025558 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 228/488] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:03 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:04.371842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-196fc814-7c32-47ad-bc15-b84fb290bf64 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:04.372445 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-196fc814-7c32-47ad-bc15-b84fb290bf64 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:04.378899 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-196fc814-7c32-47ad-bc15-b84fb290bf64 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.379369 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-196fc814-7c32-47ad-bc15-b84fb290bf64 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.379793 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-196fc814-7c32-47ad-bc15-b84fb290bf64 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.380472 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-196fc814-7c32-47ad-bc15-b84fb290bf64 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.380914 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-196fc814-7c32-47ad-bc15-b84fb290bf64 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.381326 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-196fc814-7c32-47ad-bc15-b84fb290bf64 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.512240 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-196fc814-7c32-47ad-bc15-b84fb290bf64 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:04.519955 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-196fc814-7c32-47ad-bc15-b84fb290bf64 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1471 microversion: 2.1 time: 0.152011 Sep 01 16:37:04.520548 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 261/489] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:04 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:04.560262 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-04eeb5f0-09e1-4c76-982c-d7a29f076376 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:04.560860 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-04eeb5f0-09e1-4c76-982c-d7a29f076376 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:04.566843 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04eeb5f0-09e1-4c76-982c-d7a29f076376 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.567313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04eeb5f0-09e1-4c76-982c-d7a29f076376 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.567743 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04eeb5f0-09e1-4c76-982c-d7a29f076376 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.568444 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04eeb5f0-09e1-4c76-982c-d7a29f076376 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.568885 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04eeb5f0-09e1-4c76-982c-d7a29f076376 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.569843 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04eeb5f0-09e1-4c76-982c-d7a29f076376 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.583409 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-af6331de-f2fe-4b4e-91e4-2675b4e2d3ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:04.584010 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-af6331de-f2fe-4b4e-91e4-2675b4e2d3ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:04.587811 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:04.590215 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af6331de-f2fe-4b4e-91e4-2675b4e2d3ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.590721 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af6331de-f2fe-4b4e-91e4-2675b4e2d3ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.591178 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af6331de-f2fe-4b4e-91e4-2675b4e2d3ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.591862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af6331de-f2fe-4b4e-91e4-2675b4e2d3ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.592308 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af6331de-f2fe-4b4e-91e4-2675b4e2d3ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.592731 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af6331de-f2fe-4b4e-91e4-2675b4e2d3ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.657131 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-af6331de-f2fe-4b4e-91e4-2675b4e2d3ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:04.665991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-af6331de-f2fe-4b4e-91e4-2675b4e2d3ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1144 microversion: 2.1 time: 0.086253 Sep 01 16:37:04.666854 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 262/490] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:04 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:04.711898 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-04eeb5f0-09e1-4c76-982c-d7a29f076376 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:04.719468 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-04eeb5f0-09e1-4c76-982c-d7a29f076376 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1370 microversion: 2.1 time: 0.163026 Sep 01 16:37:04.720038 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 229/491] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:04 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:05.048887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f11f2416-505e-48f9-8a7e-120d1c346779 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:05.049492 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f11f2416-505e-48f9-8a7e-120d1c346779 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:05.055952 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f11f2416-505e-48f9-8a7e-120d1c346779 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.056445 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f11f2416-505e-48f9-8a7e-120d1c346779 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.056852 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f11f2416-505e-48f9-8a7e-120d1c346779 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.057549 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f11f2416-505e-48f9-8a7e-120d1c346779 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.057990 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f11f2416-505e-48f9-8a7e-120d1c346779 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.058432 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f11f2416-505e-48f9-8a7e-120d1c346779 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.188741 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f11f2416-505e-48f9-8a7e-120d1c346779 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:05.196668 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f11f2416-505e-48f9-8a7e-120d1c346779 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:05.198083 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f11f2416-505e-48f9-8a7e-120d1c346779 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:05.199257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f11f2416-505e-48f9-8a7e-120d1c346779 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1720 microversion: 2.20 time: 0.154267 Sep 01 16:37:05.199842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 263/492] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:05 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:05.540895 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-10e7e412-3b96-48cb-870c-034cfc028345 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:05.541526 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-10e7e412-3b96-48cb-870c-034cfc028345 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:05.543996 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:05.551965 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10e7e412-3b96-48cb-870c-034cfc028345 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.552449 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10e7e412-3b96-48cb-870c-034cfc028345 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.552876 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10e7e412-3b96-48cb-870c-034cfc028345 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.554125 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10e7e412-3b96-48cb-870c-034cfc028345 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.554597 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10e7e412-3b96-48cb-870c-034cfc028345 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.555452 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10e7e412-3b96-48cb-870c-034cfc028345 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.686565 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-10e7e412-3b96-48cb-870c-034cfc028345 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:05.687582 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-66a95597-ba4e-4034-a60e-0718636da371 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:05.688189 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-66a95597-ba4e-4034-a60e-0718636da371 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:05.694679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-66a95597-ba4e-4034-a60e-0718636da371 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.694868 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-10e7e412-3b96-48cb-870c-034cfc028345 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1471 microversion: 2.1 time: 0.157794 Sep 01 16:37:05.695152 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-66a95597-ba4e-4034-a60e-0718636da371 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.695392 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 230/493] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:05 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:05.695601 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-66a95597-ba4e-4034-a60e-0718636da371 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.696322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-66a95597-ba4e-4034-a60e-0718636da371 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.696776 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-66a95597-ba4e-4034-a60e-0718636da371 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.697191 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-66a95597-ba4e-4034-a60e-0718636da371 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.739591 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7e524aa0-35a2-4496-91cc-7dc0bd5bdfd3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:05.740190 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7e524aa0-35a2-4496-91cc-7dc0bd5bdfd3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:05.747248 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7e524aa0-35a2-4496-91cc-7dc0bd5bdfd3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.747810 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7e524aa0-35a2-4496-91cc-7dc0bd5bdfd3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.748156 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7e524aa0-35a2-4496-91cc-7dc0bd5bdfd3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.748951 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7e524aa0-35a2-4496-91cc-7dc0bd5bdfd3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.749444 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7e524aa0-35a2-4496-91cc-7dc0bd5bdfd3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.749882 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7e524aa0-35a2-4496-91cc-7dc0bd5bdfd3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.929127 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-7e524aa0-35a2-4496-91cc-7dc0bd5bdfd3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:05.937057 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7e524aa0-35a2-4496-91cc-7dc0bd5bdfd3 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1370 microversion: 2.1 time: 0.201144 Sep 01 16:37:05.950374 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 231/494] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:05 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:05.966468 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-66a95597-ba4e-4034-a60e-0718636da371 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:05.974669 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-66a95597-ba4e-4034-a60e-0718636da371 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1144 microversion: 2.1 time: 0.291105 Sep 01 16:37:05.975755 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 264/495] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:05 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1144 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:06.222400 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-58a0a1c1-fe32-495d-b0d3-ad572171d9c3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:06.223031 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-58a0a1c1-fe32-495d-b0d3-ad572171d9c3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:06.229371 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-58a0a1c1-fe32-495d-b0d3-ad572171d9c3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.229850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-58a0a1c1-fe32-495d-b0d3-ad572171d9c3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.230335 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-58a0a1c1-fe32-495d-b0d3-ad572171d9c3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.231021 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-58a0a1c1-fe32-495d-b0d3-ad572171d9c3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.231595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-58a0a1c1-fe32-495d-b0d3-ad572171d9c3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.232023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-58a0a1c1-fe32-495d-b0d3-ad572171d9c3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.627967 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-58a0a1c1-fe32-495d-b0d3-ad572171d9c3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:06.636010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-58a0a1c1-fe32-495d-b0d3-ad572171d9c3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:06.637520 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-58a0a1c1-fe32-495d-b0d3-ad572171d9c3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:06.638792 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-58a0a1c1-fe32-495d-b0d3-ad572171d9c3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1723 microversion: 2.20 time: 0.421196 Sep 01 16:37:06.639352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 232/496] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:06 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:06.661247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b0a156c6-05c5-47e4-a0cd-0bd7d6178f3e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3808a0ed-562c-4bcd-9629-aee1a32b8690"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:06.664388 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b0a156c6-05c5-47e4-a0cd-0bd7d6178f3e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:06.672608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b0a156c6-05c5-47e4-a0cd-0bd7d6178f3e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.672608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b0a156c6-05c5-47e4-a0cd-0bd7d6178f3e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.672608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b0a156c6-05c5-47e4-a0cd-0bd7d6178f3e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.672608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b0a156c6-05c5-47e4-a0cd-0bd7d6178f3e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.681101 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b0a156c6-05c5-47e4-a0cd-0bd7d6178f3e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.681101 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b0a156c6-05c5-47e4-a0cd-0bd7d6178f3e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.716397 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f748a20b-09fd-4ac2-be6b-cb475f96d9ab tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:06.717320 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f748a20b-09fd-4ac2-be6b-cb475f96d9ab tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:06.731027 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f748a20b-09fd-4ac2-be6b-cb475f96d9ab tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.731705 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f748a20b-09fd-4ac2-be6b-cb475f96d9ab tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.731976 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f748a20b-09fd-4ac2-be6b-cb475f96d9ab tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.733428 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f748a20b-09fd-4ac2-be6b-cb475f96d9ab tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.734249 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f748a20b-09fd-4ac2-be6b-cb475f96d9ab tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.735384 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f748a20b-09fd-4ac2-be6b-cb475f96d9ab tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.997225 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f748a20b-09fd-4ac2-be6b-cb475f96d9ab tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:07.004875 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b0a156c6-05c5-47e4-a0cd-0bd7d6178f3e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "POST /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.347609 Sep 01 16:37:07.005828 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 265/497] 10.222.0.18 () {62 vars in 1364 bytes} [Thu Sep 1 16:37:06 2022] POST /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/os-volume_attachments => generated 188 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:37:07.010973 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c7127116-4775-4c03-bde4-8e984bcdaa56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:07.012025 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f748a20b-09fd-4ac2-be6b-cb475f96d9ab tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1471 microversion: 2.1 time: 0.298928 Sep 01 16:37:07.012439 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 233/498] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:06 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1471 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:07.012639 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c7127116-4775-4c03-bde4-8e984bcdaa56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:07.016923 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-c2708e13-842f-4c15-b305-2650ba2ffc72 req-f6f84778-1b17-4e89-90db-3f19bbbcf3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "071ec310-3768-40d1-88bf-8f8f8c3db14b", "name": "network-vif-deleted", "tag": "d3d00636-e531-4056-9749-f5ddf6e5f7b2"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:07.028049 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-c2708e13-842f-4c15-b305-2650ba2ffc72 req-f6f84778-1b17-4e89-90db-3f19bbbcf3e1 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.028705 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-c2708e13-842f-4c15-b305-2650ba2ffc72 req-f6f84778-1b17-4e89-90db-3f19bbbcf3e1 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.029300 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-c2708e13-842f-4c15-b305-2650ba2ffc72 req-f6f84778-1b17-4e89-90db-3f19bbbcf3e1 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.032319 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c7127116-4775-4c03-bde4-8e984bcdaa56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.033092 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c7127116-4775-4c03-bde4-8e984bcdaa56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.033789 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c7127116-4775-4c03-bde4-8e984bcdaa56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.034990 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c7127116-4775-4c03-bde4-8e984bcdaa56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.035655 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c7127116-4775-4c03-bde4-8e984bcdaa56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.036443 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c7127116-4775-4c03-bde4-8e984bcdaa56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.042350 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-c2708e13-842f-4c15-b305-2650ba2ffc72 req-f6f84778-1b17-4e89-90db-3f19bbbcf3e1 service nova] Creating event network-vif-deleted:d3d00636-e531-4056-9749-f5ddf6e5f7b2 for instance 071ec310-3768-40d1-88bf-8f8f8c3db14b on hv-cinder-85220 Sep 01 16:37:07.047784 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-c2708e13-842f-4c15-b305-2650ba2ffc72 req-f6f84778-1b17-4e89-90db-3f19bbbcf3e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034138 Sep 01 16:37:07.048391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 234/499] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:07.057282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-64ff17e1-4456-4811-aba1-9f4602bd65ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:07.057978 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-64ff17e1-4456-4811-aba1-9f4602bd65ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:07.067574 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-64ff17e1-4456-4811-aba1-9f4602bd65ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.068287 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-64ff17e1-4456-4811-aba1-9f4602bd65ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.068988 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-64ff17e1-4456-4811-aba1-9f4602bd65ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.069888 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-64ff17e1-4456-4811-aba1-9f4602bd65ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.070427 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-64ff17e1-4456-4811-aba1-9f4602bd65ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.070914 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-64ff17e1-4456-4811-aba1-9f4602bd65ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.155272 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-64ff17e1-4456-4811-aba1-9f4602bd65ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:07.163076 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-64ff17e1-4456-4811-aba1-9f4602bd65ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1192 microversion: 2.1 time: 0.110470 Sep 01 16:37:07.163638 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 235/500] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:07 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1192 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:07.168113 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-10a352c8-43e3-4b6c-9b74-08f549bd69b7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:07.168879 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-10a352c8-43e3-4b6c-9b74-08f549bd69b7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:07.174574 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10a352c8-43e3-4b6c-9b74-08f549bd69b7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.175056 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10a352c8-43e3-4b6c-9b74-08f549bd69b7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.175481 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10a352c8-43e3-4b6c-9b74-08f549bd69b7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.177906 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10a352c8-43e3-4b6c-9b74-08f549bd69b7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.178734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10a352c8-43e3-4b6c-9b74-08f549bd69b7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.179329 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10a352c8-43e3-4b6c-9b74-08f549bd69b7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.197313 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c7127116-4775-4c03-bde4-8e984bcdaa56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:07.205944 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c7127116-4775-4c03-bde4-8e984bcdaa56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1370 microversion: 2.1 time: 0.198515 Sep 01 16:37:07.206684 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 266/501] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:07 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:07.243241 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-10a352c8-43e3-4b6c-9b74-08f549bd69b7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127178) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 16:37:07.319279 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-10a352c8-43e3-4b6c-9b74-08f549bd69b7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "POST /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/action" status: 202 len: 0 microversion: 2.20 time: 0.153734 Sep 01 16:37:07.319900 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 236/502] 10.222.0.18 () {62 vars in 1319 bytes} [Thu Sep 1 16:37:07 2022] POST /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:37:07.327963 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-fdb5e5cd-d358-43c0-8e32-7c2a7cd986f5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:07.328570 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-fdb5e5cd-d358-43c0-8e32-7c2a7cd986f5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:07.335312 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fdb5e5cd-d358-43c0-8e32-7c2a7cd986f5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.335816 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fdb5e5cd-d358-43c0-8e32-7c2a7cd986f5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.336242 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fdb5e5cd-d358-43c0-8e32-7c2a7cd986f5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.336954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fdb5e5cd-d358-43c0-8e32-7c2a7cd986f5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.337401 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fdb5e5cd-d358-43c0-8e32-7c2a7cd986f5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.337841 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fdb5e5cd-d358-43c0-8e32-7c2a7cd986f5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.483243 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-fdb5e5cd-d358-43c0-8e32-7c2a7cd986f5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:07.492156 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-fdb5e5cd-d358-43c0-8e32-7c2a7cd986f5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:07.493608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-fdb5e5cd-d358-43c0-8e32-7c2a7cd986f5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:07.494773 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-fdb5e5cd-d358-43c0-8e32-7c2a7cd986f5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1749 microversion: 2.20 time: 0.170773 Sep 01 16:37:07.495324 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 267/503] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:07 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1749 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:08.033283 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-1e0afc83-a753-4e82-965c-05426d360e55 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:08.033992 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-1e0afc83-a753-4e82-965c-05426d360e55 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:08.040893 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1e0afc83-a753-4e82-965c-05426d360e55 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:08.041554 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1e0afc83-a753-4e82-965c-05426d360e55 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:08.041992 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1e0afc83-a753-4e82-965c-05426d360e55 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:08.043168 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1e0afc83-a753-4e82-965c-05426d360e55 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:08.043668 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1e0afc83-a753-4e82-965c-05426d360e55 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:08.044100 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1e0afc83-a753-4e82-965c-05426d360e55 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:08.077353 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1e0afc83-a753-4e82-965c-05426d360e55 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:08.077834 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1e0afc83-a753-4e82-965c-05426d360e55 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:08.078285 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1e0afc83-a753-4e82-965c-05426d360e55 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:08.078726 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.objects.instance [None req-1e0afc83-a753-4e82-965c-05426d360e55 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lazy-loading 'fault' on Instance uuid 071ec310-3768-40d1-88bf-8f8f8c3db14b {{(pid=127178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:37:08.120530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-1e0afc83-a753-4e82-965c-05426d360e55 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:08.128672 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-1e0afc83-a753-4e82-965c-05426d360e55 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1305 microversion: 2.1 time: 0.099470 Sep 01 16:37:08.129233 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 237/504] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:08 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:08.184211 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-edcde2f6-6707-4fe0-8c89-843a26a8d637 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:08.184822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-edcde2f6-6707-4fe0-8c89-843a26a8d637 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:08.190899 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edcde2f6-6707-4fe0-8c89-843a26a8d637 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:08.191380 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edcde2f6-6707-4fe0-8c89-843a26a8d637 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:08.191808 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edcde2f6-6707-4fe0-8c89-843a26a8d637 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:08.192494 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edcde2f6-6707-4fe0-8c89-843a26a8d637 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:08.192937 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edcde2f6-6707-4fe0-8c89-843a26a8d637 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:08.193349 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edcde2f6-6707-4fe0-8c89-843a26a8d637 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:08.227844 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a54f922e-d2e6-4550-86e7-241cecaf7e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:08.228792 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a54f922e-d2e6-4550-86e7-241cecaf7e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:08.235244 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a54f922e-d2e6-4550-86e7-241cecaf7e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:08.235958 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a54f922e-d2e6-4550-86e7-241cecaf7e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:08.236390 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a54f922e-d2e6-4550-86e7-241cecaf7e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:08.237089 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a54f922e-d2e6-4550-86e7-241cecaf7e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:08.237534 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a54f922e-d2e6-4550-86e7-241cecaf7e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:08.238302 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a54f922e-d2e6-4550-86e7-241cecaf7e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:08.260516 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-edcde2f6-6707-4fe0-8c89-843a26a8d637 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:08.270288 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-edcde2f6-6707-4fe0-8c89-843a26a8d637 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1192 microversion: 2.1 time: 0.090024 Sep 01 16:37:08.271042 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 268/505] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:08 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:08.415699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a54f922e-d2e6-4550-86e7-241cecaf7e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:08.428642 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a54f922e-d2e6-4550-86e7-241cecaf7e2d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1370 microversion: 2.1 time: 0.205664 Sep 01 16:37:08.442368 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 238/506] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:08 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:08.517794 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3337f49d-88b1-45cd-80b3-a14421e54a71 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:08.518463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3337f49d-88b1-45cd-80b3-a14421e54a71 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:08.525231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3337f49d-88b1-45cd-80b3-a14421e54a71 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:08.525702 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3337f49d-88b1-45cd-80b3-a14421e54a71 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:08.526118 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3337f49d-88b1-45cd-80b3-a14421e54a71 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:08.526824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3337f49d-88b1-45cd-80b3-a14421e54a71 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:08.527261 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3337f49d-88b1-45cd-80b3-a14421e54a71 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:08.527670 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3337f49d-88b1-45cd-80b3-a14421e54a71 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:08.657868 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3337f49d-88b1-45cd-80b3-a14421e54a71 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:08.667223 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3337f49d-88b1-45cd-80b3-a14421e54a71 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:08.668686 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3337f49d-88b1-45cd-80b3-a14421e54a71 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:08.669823 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3337f49d-88b1-45cd-80b3-a14421e54a71 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1749 microversion: 2.20 time: 0.155890 Sep 01 16:37:08.670399 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 269/507] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:08 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:09.148796 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-044e3fd7-e9fb-47d9-86d7-1936c6aaebd5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:09.149396 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-044e3fd7-e9fb-47d9-86d7-1936c6aaebd5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:09.156211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-044e3fd7-e9fb-47d9-86d7-1936c6aaebd5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.156681 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-044e3fd7-e9fb-47d9-86d7-1936c6aaebd5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.157106 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-044e3fd7-e9fb-47d9-86d7-1936c6aaebd5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.157777 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-044e3fd7-e9fb-47d9-86d7-1936c6aaebd5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.158218 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-044e3fd7-e9fb-47d9-86d7-1936c6aaebd5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.158652 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-044e3fd7-e9fb-47d9-86d7-1936c6aaebd5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.190187 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-044e3fd7-e9fb-47d9-86d7-1936c6aaebd5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.190681 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-044e3fd7-e9fb-47d9-86d7-1936c6aaebd5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.191111 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-044e3fd7-e9fb-47d9-86d7-1936c6aaebd5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.191782 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.objects.instance [None req-044e3fd7-e9fb-47d9-86d7-1936c6aaebd5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lazy-loading 'fault' on Instance uuid 071ec310-3768-40d1-88bf-8f8f8c3db14b {{(pid=127178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:37:09.238637 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-044e3fd7-e9fb-47d9-86d7-1936c6aaebd5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:09.247128 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-044e3fd7-e9fb-47d9-86d7-1936c6aaebd5 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1305 microversion: 2.1 time: 0.102354 Sep 01 16:37:09.247681 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 239/508] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:09 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:09.292248 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ba371f6e-6f37-482d-a53d-5b4f991b5c9c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:09.292959 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ba371f6e-6f37-482d-a53d-5b4f991b5c9c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:09.298966 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ba371f6e-6f37-482d-a53d-5b4f991b5c9c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.299437 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ba371f6e-6f37-482d-a53d-5b4f991b5c9c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.299861 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ba371f6e-6f37-482d-a53d-5b4f991b5c9c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.300534 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ba371f6e-6f37-482d-a53d-5b4f991b5c9c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.300983 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ba371f6e-6f37-482d-a53d-5b4f991b5c9c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.301408 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ba371f6e-6f37-482d-a53d-5b4f991b5c9c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.367077 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ba371f6e-6f37-482d-a53d-5b4f991b5c9c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:09.382045 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ba371f6e-6f37-482d-a53d-5b4f991b5c9c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1200 microversion: 2.1 time: 0.087794 Sep 01 16:37:09.382731 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 270/509] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:09 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1200 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:09.453955 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-003e44d6-76c0-439f-af20-339c338e6e99 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:09.454982 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-003e44d6-76c0-439f-af20-339c338e6e99 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:09.463376 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-003e44d6-76c0-439f-af20-339c338e6e99 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.463954 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-003e44d6-76c0-439f-af20-339c338e6e99 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.464449 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-003e44d6-76c0-439f-af20-339c338e6e99 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.465209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-003e44d6-76c0-439f-af20-339c338e6e99 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.465869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-003e44d6-76c0-439f-af20-339c338e6e99 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.466594 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-003e44d6-76c0-439f-af20-339c338e6e99 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.686773 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-003e44d6-76c0-439f-af20-339c338e6e99 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:09.692553 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0310fed3-c80e-4e47-a4c1-9a842e0d0cac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:09.693176 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0310fed3-c80e-4e47-a4c1-9a842e0d0cac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:09.694697 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-003e44d6-76c0-439f-af20-339c338e6e99 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1562 microversion: 2.1 time: 0.245622 Sep 01 16:37:09.695272 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 240/510] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:09 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1562 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:09.699856 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0310fed3-c80e-4e47-a4c1-9a842e0d0cac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.700328 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0310fed3-c80e-4e47-a4c1-9a842e0d0cac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.700753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0310fed3-c80e-4e47-a4c1-9a842e0d0cac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.701428 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0310fed3-c80e-4e47-a4c1-9a842e0d0cac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.701876 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0310fed3-c80e-4e47-a4c1-9a842e0d0cac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.702308 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0310fed3-c80e-4e47-a4c1-9a842e0d0cac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.714393 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-17d86add-ae53-430d-9cd7-fe38d66a61ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:09.714878 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-17d86add-ae53-430d-9cd7-fe38d66a61ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:09.720599 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17d86add-ae53-430d-9cd7-fe38d66a61ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.721090 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17d86add-ae53-430d-9cd7-fe38d66a61ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.721526 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17d86add-ae53-430d-9cd7-fe38d66a61ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.722210 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17d86add-ae53-430d-9cd7-fe38d66a61ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.722685 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17d86add-ae53-430d-9cd7-fe38d66a61ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.723105 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17d86add-ae53-430d-9cd7-fe38d66a61ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.822800 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-17d86add-ae53-430d-9cd7-fe38d66a61ab tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112022 Sep 01 16:37:09.823386 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 241/511] 10.222.0.18 () {58 vars in 1275 bytes} [Thu Sep 1 16:37:09 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:37:09.834035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0310fed3-c80e-4e47-a4c1-9a842e0d0cac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:09.843416 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0310fed3-c80e-4e47-a4c1-9a842e0d0cac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:09.844847 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0310fed3-c80e-4e47-a4c1-9a842e0d0cac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:09.845999 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0310fed3-c80e-4e47-a4c1-9a842e0d0cac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1751 microversion: 2.20 time: 0.157434 Sep 01 16:37:09.846588 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 271/512] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:09 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:10.269074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-3bf2c037-6221-4249-9fc1-cd487ba9d856 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:10.269792 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-3bf2c037-6221-4249-9fc1-cd487ba9d856 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:10.276798 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3bf2c037-6221-4249-9fc1-cd487ba9d856 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.277286 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3bf2c037-6221-4249-9fc1-cd487ba9d856 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.277721 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3bf2c037-6221-4249-9fc1-cd487ba9d856 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.278453 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3bf2c037-6221-4249-9fc1-cd487ba9d856 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.278901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3bf2c037-6221-4249-9fc1-cd487ba9d856 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.279378 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3bf2c037-6221-4249-9fc1-cd487ba9d856 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.312099 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3bf2c037-6221-4249-9fc1-cd487ba9d856 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.312584 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3bf2c037-6221-4249-9fc1-cd487ba9d856 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.313061 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3bf2c037-6221-4249-9fc1-cd487ba9d856 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.313462 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.objects.instance [None req-3bf2c037-6221-4249-9fc1-cd487ba9d856 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lazy-loading 'fault' on Instance uuid 071ec310-3768-40d1-88bf-8f8f8c3db14b {{(pid=127178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:37:10.405083 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7e018eb2-25e1-4afa-8437-c87511d50fea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:10.406342 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7e018eb2-25e1-4afa-8437-c87511d50fea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:10.412913 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e018eb2-25e1-4afa-8437-c87511d50fea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.413975 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e018eb2-25e1-4afa-8437-c87511d50fea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.414463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e018eb2-25e1-4afa-8437-c87511d50fea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.415338 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e018eb2-25e1-4afa-8437-c87511d50fea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.415794 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e018eb2-25e1-4afa-8437-c87511d50fea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.416354 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e018eb2-25e1-4afa-8437-c87511d50fea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.516578 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7e018eb2-25e1-4afa-8437-c87511d50fea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:10.531739 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7e018eb2-25e1-4afa-8437-c87511d50fea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1210 microversion: 2.1 time: 0.129181 Sep 01 16:37:10.532567 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-3bf2c037-6221-4249-9fc1-cd487ba9d856 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f1c977d036430683b22364ab454102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6536d1bc0651452092114f0a0650583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:10.540795 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-3bf2c037-6221-4249-9fc1-cd487ba9d856 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 200 len: 1305 microversion: 2.1 time: 0.276192 Sep 01 16:37:10.541455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 242/513] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:10 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 1305 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:10.546877 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 272/514] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:10 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1210 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:10.617303 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-3e0cb0ea-2a39-4c1e-bf20-0f81c73043c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81b8e388-cfe2-4a70-91ac-d8aed3cd0b02", "device": "/dev/sdb"}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:10.621221 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-3e0cb0ea-2a39-4c1e-bf20-0f81c73043c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:10.628426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e0cb0ea-2a39-4c1e-bf20-0f81c73043c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.629525 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e0cb0ea-2a39-4c1e-bf20-0f81c73043c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.630037 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e0cb0ea-2a39-4c1e-bf20-0f81c73043c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.630856 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e0cb0ea-2a39-4c1e-bf20-0f81c73043c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.631959 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e0cb0ea-2a39-4c1e-bf20-0f81c73043c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.632434 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e0cb0ea-2a39-4c1e-bf20-0f81c73043c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.869638 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-73627eaf-44b9-454b-8c33-bd887f8b1286 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:10.870719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-73627eaf-44b9-454b-8c33-bd887f8b1286 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:10.877557 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73627eaf-44b9-454b-8c33-bd887f8b1286 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.878037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73627eaf-44b9-454b-8c33-bd887f8b1286 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.878525 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73627eaf-44b9-454b-8c33-bd887f8b1286 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.879223 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73627eaf-44b9-454b-8c33-bd887f8b1286 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.879676 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73627eaf-44b9-454b-8c33-bd887f8b1286 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.880092 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73627eaf-44b9-454b-8c33-bd887f8b1286 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.884837 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:11.046333 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-73627eaf-44b9-454b-8c33-bd887f8b1286 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:11.059410 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-73627eaf-44b9-454b-8c33-bd887f8b1286 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:11.061044 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-73627eaf-44b9-454b-8c33-bd887f8b1286 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:11.062251 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-73627eaf-44b9-454b-8c33-bd887f8b1286 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1751 microversion: 2.20 time: 0.196969 Sep 01 16:37:11.063277 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 273/515] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:10 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1751 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:11.083233 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:11.097259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-3e0cb0ea-2a39-4c1e-bf20-0f81c73043c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "POST /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485426 Sep 01 16:37:11.099108 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 243/516] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 1 16:37:10 2022] POST /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024/os-volume_attachments => generated 194 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:11.567757 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c8c40400-d5ef-40d4-bc33-1d55c64b7d86 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:11.568472 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c8c40400-d5ef-40d4-bc33-1d55c64b7d86 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:11.571545 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6a3ce33f-9453-4280-9059-e9b8681f4f69 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:11.580326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-6a3ce33f-9453-4280-9059-e9b8681f4f69 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] [instance: 071ec310-3768-40d1-88bf-8f8f8c3db14b] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:11.586270 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8c40400-d5ef-40d4-bc33-1d55c64b7d86 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:11.598547 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a3ce33f-9453-4280-9059-e9b8681f4f69 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:11.599622 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8c40400-d5ef-40d4-bc33-1d55c64b7d86 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:11.600451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8c40400-d5ef-40d4-bc33-1d55c64b7d86 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:11.603717 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8c40400-d5ef-40d4-bc33-1d55c64b7d86 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:11.604304 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8c40400-d5ef-40d4-bc33-1d55c64b7d86 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:11.604960 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8c40400-d5ef-40d4-bc33-1d55c64b7d86 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:11.610901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a3ce33f-9453-4280-9059-e9b8681f4f69 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:11.611449 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a3ce33f-9453-4280-9059-e9b8681f4f69 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:11.612209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a3ce33f-9453-4280-9059-e9b8681f4f69 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:11.612679 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a3ce33f-9453-4280-9059-e9b8681f4f69 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:11.613434 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a3ce33f-9453-4280-9059-e9b8681f4f69 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:11.645149 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-6a3ce33f-9453-4280-9059-e9b8681f4f69 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] HTTP exception thrown: Instance 071ec310-3768-40d1-88bf-8f8f8c3db14b could not be found. Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6a3ce33f-9453-4280-9059-e9b8681f4f69 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Request method failure captured: Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b HTTP/1.1 Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN-ZB8oq3By_ZZchf0wZVzQ5gxnvc1queKbVdyl3PWmR6c4pAMQj1l2Eg5DY976xMEy8wC3QqRaxSPJU1EVbgpY4Q7s8phcBJrsnCv7w74ryExv0_-m9Uyy7qUxlXke0UwxTfkNna1QaiB18lb2Bg2xh6qf9RhlhJfNHwZCe3LN88m8 Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: 6536d1bc0651452092114f0a0650583e Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-VolumesNegativeTest-1548435614 Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:37:11.649825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:37:11.651220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6536d1bc0651452092114f0a0650583e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6536d1bc0651452092114f0a0650583e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6536d1bc0651452092114f0a0650583e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6536d1bc0651452092114f0a0650583e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:37:11.651220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-VolumesNegativeTest-1548435614 Sep 01 16:37:11.651220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: 6536d1bc0651452092114f0a0650583e Sep 01 16:37:11.651220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-VolumesNegativeTest-1548435614 Sep 01 16:37:11.651220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-VolumesNegativeTest-1548435614-project Sep 01 16:37:11.651220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:37:11.651220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:37:11.651220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: f7f1c977d036430683b22364ab454102 Sep 01 16:37:11.651220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-VolumesNegativeTest-1548435614-project Sep 01 16:37:11.651220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:37:11.651220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance 071ec310-3768-40d1-88bf-8f8f8c3db14b could not be found. Sep 01 16:37:11.651220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': '071ec310-3768-40d1-88bf-8f8f8c3db14b'} Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 071ec310-3768-40d1-88bf-8f8f8c3db14b could not be found. Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:37:11.651947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 071ec310-3768-40d1-88bf-8f8f8c3db14b could not be found. Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 071ec310-3768-40d1-88bf-8f8f8c3db14b could not be found. Sep 01 16:37:11.653692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:37:11.656437 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6a3ce33f-9453-4280-9059-e9b8681f4f69 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] Returning 404 to user: Instance 071ec310-3768-40d1-88bf-8f8f8c3db14b could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:37:11.657968 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-6a3ce33f-9453-4280-9059-e9b8681f4f69 tempest-VolumesNegativeTest-1548435614 tempest-VolumesNegativeTest-1548435614-project] 10.222.0.18 "GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b" status: 404 len: 111 microversion: 2.1 time: 0.098993 Sep 01 16:37:11.666436 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 244/517] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:11 2022] GET /compute/v2.1/servers/071ec310-3768-40d1-88bf-8f8f8c3db14b => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:37:11.883062 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c8c40400-d5ef-40d4-bc33-1d55c64b7d86 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:11.891466 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c8c40400-d5ef-40d4-bc33-1d55c64b7d86 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1278 microversion: 2.1 time: 0.328080 Sep 01 16:37:11.892055 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 274/518] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:11 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1278 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:11.950828 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-7e0bf992-2d0f-439b-b7f2-e03d1ac13ca9 req-e50fff67-530e-4ad9-9c7b-93fa4b245e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f1e8ce-fea9-426e-8ce0-23b9f7851b4e", "tag": "2b174a59-f0a9-4b1a-9233-ea65d28a5d38"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:11.979454 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-7e0bf992-2d0f-439b-b7f2-e03d1ac13ca9 req-e50fff67-530e-4ad9-9c7b-93fa4b245e54 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:11.980202 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-7e0bf992-2d0f-439b-b7f2-e03d1ac13ca9 req-e50fff67-530e-4ad9-9c7b-93fa4b245e54 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:11.981645 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-7e0bf992-2d0f-439b-b7f2-e03d1ac13ca9 req-e50fff67-530e-4ad9-9c7b-93fa4b245e54 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:12.009080 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-7e0bf992-2d0f-439b-b7f2-e03d1ac13ca9 req-e50fff67-530e-4ad9-9c7b-93fa4b245e54 service nova] Creating event network-changed:2b174a59-f0a9-4b1a-9233-ea65d28a5d38 for instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e on hv-cinder-85220 Sep 01 16:37:12.017898 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-7e0bf992-2d0f-439b-b7f2-e03d1ac13ca9 req-e50fff67-530e-4ad9-9c7b-93fa4b245e54 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077220 Sep 01 16:37:12.018534 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 245/519] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:12.089756 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f3606ab5-5bad-4bd8-81d1-bd1241e22e13 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:12.090352 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f3606ab5-5bad-4bd8-81d1-bd1241e22e13 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:12.098151 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3606ab5-5bad-4bd8-81d1-bd1241e22e13 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:12.099307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3606ab5-5bad-4bd8-81d1-bd1241e22e13 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:12.101556 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3606ab5-5bad-4bd8-81d1-bd1241e22e13 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:12.102908 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3606ab5-5bad-4bd8-81d1-bd1241e22e13 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:12.103679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3606ab5-5bad-4bd8-81d1-bd1241e22e13 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:12.104817 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3606ab5-5bad-4bd8-81d1-bd1241e22e13 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:12.171323 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:12.189550 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=6 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:12.341451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f3606ab5-5bad-4bd8-81d1-bd1241e22e13 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:12.365178 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f3606ab5-5bad-4bd8-81d1-bd1241e22e13 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:12.375455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f3606ab5-5bad-4bd8-81d1-bd1241e22e13 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:12.378138 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f3606ab5-5bad-4bd8-81d1-bd1241e22e13 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.294393 Sep 01 16:37:12.395216 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 275/520] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:12 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:12.921365 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-574cd175-e22e-4619-9a46-2448e981773e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:12.922193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-574cd175-e22e-4619-9a46-2448e981773e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:12.924515 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:12.937917 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-574cd175-e22e-4619-9a46-2448e981773e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:12.938351 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-574cd175-e22e-4619-9a46-2448e981773e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:12.938833 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-574cd175-e22e-4619-9a46-2448e981773e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:12.939702 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-574cd175-e22e-4619-9a46-2448e981773e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:12.940162 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-574cd175-e22e-4619-9a46-2448e981773e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:12.940742 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-574cd175-e22e-4619-9a46-2448e981773e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:13.401220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-26459eb9-6a0c-4c05-92b5-f4d366daad17 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:13.401824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-26459eb9-6a0c-4c05-92b5-f4d366daad17 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:13.411632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26459eb9-6a0c-4c05-92b5-f4d366daad17 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:13.412213 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26459eb9-6a0c-4c05-92b5-f4d366daad17 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:13.413245 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26459eb9-6a0c-4c05-92b5-f4d366daad17 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:13.413963 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26459eb9-6a0c-4c05-92b5-f4d366daad17 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:13.414724 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26459eb9-6a0c-4c05-92b5-f4d366daad17 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:13.415125 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26459eb9-6a0c-4c05-92b5-f4d366daad17 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:13.560784 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-574cd175-e22e-4619-9a46-2448e981773e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:13.569867 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-574cd175-e22e-4619-9a46-2448e981773e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.660296 Sep 01 16:37:13.570720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 246/521] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:12 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:13.623928 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-26459eb9-6a0c-4c05-92b5-f4d366daad17 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:13.636204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-26459eb9-6a0c-4c05-92b5-f4d366daad17 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:13.637652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-26459eb9-6a0c-4c05-92b5-f4d366daad17 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:13.638868 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-26459eb9-6a0c-4c05-92b5-f4d366daad17 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.241971 Sep 01 16:37:13.642918 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 276/522] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:13 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:14.048644 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-e697e84e-df24-4391-8e32-115ea424588f req-58685b47-10c8-498b-9df1-d68694b98bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de83f04b-508f-4b6f-88da-92857f482014", "tag": "9ed23239-98a4-43e2-9a12-3bdb7d38814e"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:14.061981 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-e697e84e-df24-4391-8e32-115ea424588f req-58685b47-10c8-498b-9df1-d68694b98bd7 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.062652 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-e697e84e-df24-4391-8e32-115ea424588f req-58685b47-10c8-498b-9df1-d68694b98bd7 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.063251 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-e697e84e-df24-4391-8e32-115ea424588f req-58685b47-10c8-498b-9df1-d68694b98bd7 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:14.078617 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-e697e84e-df24-4391-8e32-115ea424588f req-58685b47-10c8-498b-9df1-d68694b98bd7 service nova] Creating event network-changed:9ed23239-98a4-43e2-9a12-3bdb7d38814e for instance de83f04b-508f-4b6f-88da-92857f482014 on hv-cinder-85220 Sep 01 16:37:14.083542 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-e697e84e-df24-4391-8e32-115ea424588f req-58685b47-10c8-498b-9df1-d68694b98bd7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041620 Sep 01 16:37:14.084281 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 247/523] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:14.596908 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-20626e5e-2603-4cdf-9a3c-3061ca2bf9cb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:14.597515 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-20626e5e-2603-4cdf-9a3c-3061ca2bf9cb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:14.609056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20626e5e-2603-4cdf-9a3c-3061ca2bf9cb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.609580 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20626e5e-2603-4cdf-9a3c-3061ca2bf9cb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.610004 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20626e5e-2603-4cdf-9a3c-3061ca2bf9cb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:14.610729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20626e5e-2603-4cdf-9a3c-3061ca2bf9cb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.611174 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20626e5e-2603-4cdf-9a3c-3061ca2bf9cb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.611587 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20626e5e-2603-4cdf-9a3c-3061ca2bf9cb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:14.665815 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-0c04c782-5c1c-4ae1-bf4c-7ead15662b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:14.666583 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0c04c782-5c1c-4ae1-bf4c-7ead15662b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:14.673053 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0c04c782-5c1c-4ae1-bf4c-7ead15662b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.673596 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0c04c782-5c1c-4ae1-bf4c-7ead15662b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.674045 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0c04c782-5c1c-4ae1-bf4c-7ead15662b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:14.674760 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0c04c782-5c1c-4ae1-bf4c-7ead15662b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.675207 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0c04c782-5c1c-4ae1-bf4c-7ead15662b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.675624 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0c04c782-5c1c-4ae1-bf4c-7ead15662b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:14.768846 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-20626e5e-2603-4cdf-9a3c-3061ca2bf9cb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:14.787484 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-20626e5e-2603-4cdf-9a3c-3061ca2bf9cb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.194080 Sep 01 16:37:14.799066 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 277/524] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:14 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:14.866653 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0c04c782-5c1c-4ae1-bf4c-7ead15662b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:14.875409 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0c04c782-5c1c-4ae1-bf4c-7ead15662b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:14.876923 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0c04c782-5c1c-4ae1-bf4c-7ead15662b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:14.878159 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-0c04c782-5c1c-4ae1-bf4c-7ead15662b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.217094 Sep 01 16:37:14.878835 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 248/525] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:14 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:15.808666 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7bc544e9-2274-43f1-bcd4-047318407047 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:15.809272 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7bc544e9-2274-43f1-bcd4-047318407047 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:15.815879 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bc544e9-2274-43f1-bcd4-047318407047 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:15.816356 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bc544e9-2274-43f1-bcd4-047318407047 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:15.816888 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bc544e9-2274-43f1-bcd4-047318407047 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:15.817613 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bc544e9-2274-43f1-bcd4-047318407047 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:15.818087 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bc544e9-2274-43f1-bcd4-047318407047 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:15.818538 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bc544e9-2274-43f1-bcd4-047318407047 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:15.901057 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7c5bf185-42a0-424e-82ac-9c9511378694 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:15.902281 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7c5bf185-42a0-424e-82ac-9c9511378694 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:15.909561 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c5bf185-42a0-424e-82ac-9c9511378694 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:15.909561 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c5bf185-42a0-424e-82ac-9c9511378694 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:15.909944 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c5bf185-42a0-424e-82ac-9c9511378694 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:15.910666 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c5bf185-42a0-424e-82ac-9c9511378694 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:15.911112 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c5bf185-42a0-424e-82ac-9c9511378694 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:15.911547 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c5bf185-42a0-424e-82ac-9c9511378694 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:15.970740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7bc544e9-2274-43f1-bcd4-047318407047 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:15.984772 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7bc544e9-2274-43f1-bcd4-047318407047 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.177953 Sep 01 16:37:15.985466 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 278/526] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:15 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:16.062754 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-7c5bf185-42a0-424e-82ac-9c9511378694 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:16.077278 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-7c5bf185-42a0-424e-82ac-9c9511378694 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:16.078752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-7c5bf185-42a0-424e-82ac-9c9511378694 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:16.080013 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7c5bf185-42a0-424e-82ac-9c9511378694 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.183049 Sep 01 16:37:16.080574 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 249/527] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:15 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:17.006733 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-95b69416-83dd-4cc4-8ce6-9013699908ed tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:17.008015 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-95b69416-83dd-4cc4-8ce6-9013699908ed tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:17.010642 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:17.017334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95b69416-83dd-4cc4-8ce6-9013699908ed tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:17.018171 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95b69416-83dd-4cc4-8ce6-9013699908ed tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:17.018741 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95b69416-83dd-4cc4-8ce6-9013699908ed tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:17.019558 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95b69416-83dd-4cc4-8ce6-9013699908ed tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:17.020359 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95b69416-83dd-4cc4-8ce6-9013699908ed tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:17.020947 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95b69416-83dd-4cc4-8ce6-9013699908ed tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:17.103404 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-1268b3a3-e24c-46d3-83e9-2460f77ca488 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:17.104026 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-1268b3a3-e24c-46d3-83e9-2460f77ca488 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:17.110554 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1268b3a3-e24c-46d3-83e9-2460f77ca488 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:17.111268 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1268b3a3-e24c-46d3-83e9-2460f77ca488 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:17.111882 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1268b3a3-e24c-46d3-83e9-2460f77ca488 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:17.112752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1268b3a3-e24c-46d3-83e9-2460f77ca488 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:17.113206 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1268b3a3-e24c-46d3-83e9-2460f77ca488 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:17.113630 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1268b3a3-e24c-46d3-83e9-2460f77ca488 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:17.171034 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-95b69416-83dd-4cc4-8ce6-9013699908ed tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:17.179014 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-95b69416-83dd-4cc4-8ce6-9013699908ed tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.176640 Sep 01 16:37:17.179593 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 279/528] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:17 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:17.265950 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-1268b3a3-e24c-46d3-83e9-2460f77ca488 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:17.276612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-1268b3a3-e24c-46d3-83e9-2460f77ca488 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:17.278112 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-1268b3a3-e24c-46d3-83e9-2460f77ca488 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:17.279404 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-1268b3a3-e24c-46d3-83e9-2460f77ca488 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.180307 Sep 01 16:37:17.279984 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 250/529] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:17 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:18.199308 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-421d2b57-aa4a-4715-bb30-1500bcd2c9c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:18.199946 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-421d2b57-aa4a-4715-bb30-1500bcd2c9c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:18.206504 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-421d2b57-aa4a-4715-bb30-1500bcd2c9c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:18.206967 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-421d2b57-aa4a-4715-bb30-1500bcd2c9c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:18.207402 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-421d2b57-aa4a-4715-bb30-1500bcd2c9c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:18.208254 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-421d2b57-aa4a-4715-bb30-1500bcd2c9c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:18.208586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-421d2b57-aa4a-4715-bb30-1500bcd2c9c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:18.209006 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-421d2b57-aa4a-4715-bb30-1500bcd2c9c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:18.301881 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-5f5a3e4d-1653-4106-bbf9-24a6e8211010 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:18.302652 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-5f5a3e4d-1653-4106-bbf9-24a6e8211010 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:18.310541 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5f5a3e4d-1653-4106-bbf9-24a6e8211010 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:18.311326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5f5a3e4d-1653-4106-bbf9-24a6e8211010 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:18.311976 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5f5a3e4d-1653-4106-bbf9-24a6e8211010 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:18.313065 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5f5a3e4d-1653-4106-bbf9-24a6e8211010 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:18.313678 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5f5a3e4d-1653-4106-bbf9-24a6e8211010 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:18.314261 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5f5a3e4d-1653-4106-bbf9-24a6e8211010 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:18.367466 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-421d2b57-aa4a-4715-bb30-1500bcd2c9c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:18.376699 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-421d2b57-aa4a-4715-bb30-1500bcd2c9c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.181183 Sep 01 16:37:18.378934 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 280/530] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:18 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:18.487989 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-5f5a3e4d-1653-4106-bbf9-24a6e8211010 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:18.498185 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-5f5a3e4d-1653-4106-bbf9-24a6e8211010 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:18.499713 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-5f5a3e4d-1653-4106-bbf9-24a6e8211010 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:18.500889 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-5f5a3e4d-1653-4106-bbf9-24a6e8211010 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.202872 Sep 01 16:37:18.501446 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 251/531] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:18 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:19.399552 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4354761f-0eea-4400-8c96-7df8b0b662ab tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:19.400153 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4354761f-0eea-4400-8c96-7df8b0b662ab tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:19.407316 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4354761f-0eea-4400-8c96-7df8b0b662ab tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:19.408051 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4354761f-0eea-4400-8c96-7df8b0b662ab tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:19.408704 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4354761f-0eea-4400-8c96-7df8b0b662ab tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:19.409589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4354761f-0eea-4400-8c96-7df8b0b662ab tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:19.410222 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4354761f-0eea-4400-8c96-7df8b0b662ab tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:19.410848 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4354761f-0eea-4400-8c96-7df8b0b662ab tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:19.528772 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a36c035d-40d6-4361-a068-32da9e3edfc5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:19.529379 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a36c035d-40d6-4361-a068-32da9e3edfc5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:19.542684 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a36c035d-40d6-4361-a068-32da9e3edfc5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:19.543276 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a36c035d-40d6-4361-a068-32da9e3edfc5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:19.543779 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a36c035d-40d6-4361-a068-32da9e3edfc5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:19.544582 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a36c035d-40d6-4361-a068-32da9e3edfc5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:19.545082 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a36c035d-40d6-4361-a068-32da9e3edfc5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:19.545567 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a36c035d-40d6-4361-a068-32da9e3edfc5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:19.605988 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4354761f-0eea-4400-8c96-7df8b0b662ab tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:19.618680 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4354761f-0eea-4400-8c96-7df8b0b662ab tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.222997 Sep 01 16:37:19.619495 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 281/532] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:19 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:19.700246 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a36c035d-40d6-4361-a068-32da9e3edfc5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:19.709181 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a36c035d-40d6-4361-a068-32da9e3edfc5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:19.710687 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a36c035d-40d6-4361-a068-32da9e3edfc5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:19.711831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a36c035d-40d6-4361-a068-32da9e3edfc5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.191595 Sep 01 16:37:19.712389 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 252/533] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:19 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:20.639722 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7bf282b1-0b88-47fe-a74e-99168d2d09ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:20.640271 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7bf282b1-0b88-47fe-a74e-99168d2d09ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:20.646811 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bf282b1-0b88-47fe-a74e-99168d2d09ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:20.647288 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bf282b1-0b88-47fe-a74e-99168d2d09ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:20.648081 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bf282b1-0b88-47fe-a74e-99168d2d09ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:20.648776 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bf282b1-0b88-47fe-a74e-99168d2d09ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:20.649224 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bf282b1-0b88-47fe-a74e-99168d2d09ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:20.649641 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bf282b1-0b88-47fe-a74e-99168d2d09ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:20.736683 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b990f934-b4e7-48b1-96ce-ea2267f3c579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:20.737433 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b990f934-b4e7-48b1-96ce-ea2267f3c579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:20.745150 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b990f934-b4e7-48b1-96ce-ea2267f3c579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:20.745715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b990f934-b4e7-48b1-96ce-ea2267f3c579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:20.746555 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b990f934-b4e7-48b1-96ce-ea2267f3c579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:20.747242 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b990f934-b4e7-48b1-96ce-ea2267f3c579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:20.747702 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b990f934-b4e7-48b1-96ce-ea2267f3c579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:20.748131 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b990f934-b4e7-48b1-96ce-ea2267f3c579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:20.791287 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7bf282b1-0b88-47fe-a74e-99168d2d09ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:20.802620 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7bf282b1-0b88-47fe-a74e-99168d2d09ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.163929 Sep 01 16:37:20.817867 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 282/534] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:20 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:20.898465 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b990f934-b4e7-48b1-96ce-ea2267f3c579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:20.907828 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b990f934-b4e7-48b1-96ce-ea2267f3c579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:20.909297 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b990f934-b4e7-48b1-96ce-ea2267f3c579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:20.910504 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b990f934-b4e7-48b1-96ce-ea2267f3c579 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.178143 Sep 01 16:37:20.911244 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 253/535] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:20 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:21.825936 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cd128b8b-41d3-43f6-a4fb-f79156e5eb40 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:21.826617 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cd128b8b-41d3-43f6-a4fb-f79156e5eb40 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:21.833058 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd128b8b-41d3-43f6-a4fb-f79156e5eb40 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:21.833760 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd128b8b-41d3-43f6-a4fb-f79156e5eb40 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:21.834391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd128b8b-41d3-43f6-a4fb-f79156e5eb40 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:21.835120 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd128b8b-41d3-43f6-a4fb-f79156e5eb40 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:21.836109 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd128b8b-41d3-43f6-a4fb-f79156e5eb40 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:21.836527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd128b8b-41d3-43f6-a4fb-f79156e5eb40 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:21.933170 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ee1cf187-7417-477b-9ab5-44fc1aa2bf34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:21.933843 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ee1cf187-7417-477b-9ab5-44fc1aa2bf34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:21.940097 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee1cf187-7417-477b-9ab5-44fc1aa2bf34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:21.940571 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee1cf187-7417-477b-9ab5-44fc1aa2bf34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:21.940996 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee1cf187-7417-477b-9ab5-44fc1aa2bf34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:21.941706 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee1cf187-7417-477b-9ab5-44fc1aa2bf34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:21.942158 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee1cf187-7417-477b-9ab5-44fc1aa2bf34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:21.942594 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee1cf187-7417-477b-9ab5-44fc1aa2bf34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:21.979233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cd128b8b-41d3-43f6-a4fb-f79156e5eb40 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:21.987422 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cd128b8b-41d3-43f6-a4fb-f79156e5eb40 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.165285 Sep 01 16:37:21.987988 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 283/536] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:21 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:22.093339 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ee1cf187-7417-477b-9ab5-44fc1aa2bf34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:22.102480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ee1cf187-7417-477b-9ab5-44fc1aa2bf34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:22.103911 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ee1cf187-7417-477b-9ab5-44fc1aa2bf34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:22.105061 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ee1cf187-7417-477b-9ab5-44fc1aa2bf34 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.175852 Sep 01 16:37:22.105801 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 254/537] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:21 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:23.009019 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4e7adaa0-b332-433e-a358-8e319c61c45c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:23.009708 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4e7adaa0-b332-433e-a358-8e319c61c45c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:23.016706 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e7adaa0-b332-433e-a358-8e319c61c45c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:23.017539 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e7adaa0-b332-433e-a358-8e319c61c45c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:23.017977 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e7adaa0-b332-433e-a358-8e319c61c45c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:23.018716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e7adaa0-b332-433e-a358-8e319c61c45c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:23.019168 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e7adaa0-b332-433e-a358-8e319c61c45c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:23.019596 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e7adaa0-b332-433e-a358-8e319c61c45c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:23.128459 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-5e074a11-cdb9-43a4-9a34-5dca55672bad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:23.129930 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-5e074a11-cdb9-43a4-9a34-5dca55672bad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:23.137660 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5e074a11-cdb9-43a4-9a34-5dca55672bad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:23.138277 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5e074a11-cdb9-43a4-9a34-5dca55672bad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:23.138844 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5e074a11-cdb9-43a4-9a34-5dca55672bad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:23.139652 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5e074a11-cdb9-43a4-9a34-5dca55672bad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:23.140195 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5e074a11-cdb9-43a4-9a34-5dca55672bad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:23.140691 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5e074a11-cdb9-43a4-9a34-5dca55672bad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:23.164927 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4e7adaa0-b332-433e-a358-8e319c61c45c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:23.172983 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4e7adaa0-b332-433e-a358-8e319c61c45c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.167797 Sep 01 16:37:23.173690 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 284/538] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:23 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:23.280748 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-5e074a11-cdb9-43a4-9a34-5dca55672bad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:23.289851 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-5e074a11-cdb9-43a4-9a34-5dca55672bad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:23.291388 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-5e074a11-cdb9-43a4-9a34-5dca55672bad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:23.292560 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-5e074a11-cdb9-43a4-9a34-5dca55672bad tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.168978 Sep 01 16:37:23.293176 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 255/539] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:23 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:24.192840 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c02f88c1-830d-4c29-90b2-2ff80ea875ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:24.193472 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c02f88c1-830d-4c29-90b2-2ff80ea875ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:24.200387 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c02f88c1-830d-4c29-90b2-2ff80ea875ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.200873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c02f88c1-830d-4c29-90b2-2ff80ea875ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.201294 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c02f88c1-830d-4c29-90b2-2ff80ea875ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:24.201985 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c02f88c1-830d-4c29-90b2-2ff80ea875ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.202469 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c02f88c1-830d-4c29-90b2-2ff80ea875ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.203157 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c02f88c1-830d-4c29-90b2-2ff80ea875ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:24.315751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-15f691a3-91f1-4d42-97fb-ab72e09686a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:24.316578 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-15f691a3-91f1-4d42-97fb-ab72e09686a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:24.324441 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-15f691a3-91f1-4d42-97fb-ab72e09686a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.324927 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-15f691a3-91f1-4d42-97fb-ab72e09686a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.325355 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-15f691a3-91f1-4d42-97fb-ab72e09686a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:24.326045 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-15f691a3-91f1-4d42-97fb-ab72e09686a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.326505 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-15f691a3-91f1-4d42-97fb-ab72e09686a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.327106 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-15f691a3-91f1-4d42-97fb-ab72e09686a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:24.346306 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c02f88c1-830d-4c29-90b2-2ff80ea875ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:24.354959 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c02f88c1-830d-4c29-90b2-2ff80ea875ee tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.165838 Sep 01 16:37:24.355562 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 285/540] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:24 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:24.480267 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-15f691a3-91f1-4d42-97fb-ab72e09686a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:24.489774 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-15f691a3-91f1-4d42-97fb-ab72e09686a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:24.491234 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-15f691a3-91f1-4d42-97fb-ab72e09686a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:24.492370 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-15f691a3-91f1-4d42-97fb-ab72e09686a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.180746 Sep 01 16:37:24.492919 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 256/541] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:24 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:25.374831 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f131cabd-8e87-4999-9754-321d07f965e5 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:25.375430 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f131cabd-8e87-4999-9754-321d07f965e5 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:25.381791 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f131cabd-8e87-4999-9754-321d07f965e5 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:25.382279 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f131cabd-8e87-4999-9754-321d07f965e5 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:25.382707 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f131cabd-8e87-4999-9754-321d07f965e5 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:25.383378 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f131cabd-8e87-4999-9754-321d07f965e5 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:25.383819 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f131cabd-8e87-4999-9754-321d07f965e5 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:25.384226 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f131cabd-8e87-4999-9754-321d07f965e5 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:25.515781 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e409e134-e0a3-40ae-8f9b-d375c3db9642 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:25.516261 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f131cabd-8e87-4999-9754-321d07f965e5 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:25.516399 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-e409e134-e0a3-40ae-8f9b-d375c3db9642 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:25.522623 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e409e134-e0a3-40ae-8f9b-d375c3db9642 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:25.523109 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e409e134-e0a3-40ae-8f9b-d375c3db9642 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:25.523537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e409e134-e0a3-40ae-8f9b-d375c3db9642 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:25.523807 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f131cabd-8e87-4999-9754-321d07f965e5 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.152766 Sep 01 16:37:25.524220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e409e134-e0a3-40ae-8f9b-d375c3db9642 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:25.524528 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 286/542] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:25 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:25.528881 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e409e134-e0a3-40ae-8f9b-d375c3db9642 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:25.529346 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e409e134-e0a3-40ae-8f9b-d375c3db9642 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:25.660692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e409e134-e0a3-40ae-8f9b-d375c3db9642 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:25.669231 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e409e134-e0a3-40ae-8f9b-d375c3db9642 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:25.670683 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e409e134-e0a3-40ae-8f9b-d375c3db9642 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:25.671869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-e409e134-e0a3-40ae-8f9b-d375c3db9642 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.159982 Sep 01 16:37:25.672431 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 257/543] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:25 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:26.545522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2e617eb2-3ab6-48b1-a4cd-c84e0fbadf6b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:26.546122 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2e617eb2-3ab6-48b1-a4cd-c84e0fbadf6b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:26.552546 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2e617eb2-3ab6-48b1-a4cd-c84e0fbadf6b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:26.552958 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2e617eb2-3ab6-48b1-a4cd-c84e0fbadf6b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:26.553526 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2e617eb2-3ab6-48b1-a4cd-c84e0fbadf6b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:26.554204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2e617eb2-3ab6-48b1-a4cd-c84e0fbadf6b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:26.554675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2e617eb2-3ab6-48b1-a4cd-c84e0fbadf6b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:26.555096 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2e617eb2-3ab6-48b1-a4cd-c84e0fbadf6b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:26.684516 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2e617eb2-3ab6-48b1-a4cd-c84e0fbadf6b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:26.692460 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2e617eb2-3ab6-48b1-a4cd-c84e0fbadf6b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.151297 Sep 01 16:37:26.693053 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 287/544] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:26 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:26.694732 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b7e9021d-0460-42f9-a454-79aaa287ad93 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:26.695329 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b7e9021d-0460-42f9-a454-79aaa287ad93 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:26.701784 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7e9021d-0460-42f9-a454-79aaa287ad93 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:26.702276 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7e9021d-0460-42f9-a454-79aaa287ad93 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:26.702704 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7e9021d-0460-42f9-a454-79aaa287ad93 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:26.703379 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7e9021d-0460-42f9-a454-79aaa287ad93 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:26.703827 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7e9021d-0460-42f9-a454-79aaa287ad93 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:26.704241 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7e9021d-0460-42f9-a454-79aaa287ad93 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:26.833603 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b7e9021d-0460-42f9-a454-79aaa287ad93 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:26.842589 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b7e9021d-0460-42f9-a454-79aaa287ad93 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:26.844002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b7e9021d-0460-42f9-a454-79aaa287ad93 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:26.845139 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b7e9021d-0460-42f9-a454-79aaa287ad93 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.154377 Sep 01 16:37:26.845700 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 258/545] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:26 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:27.712962 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-72d4b6c6-9dbc-4de0-8922-6553d6c18dce tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:27.713563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-72d4b6c6-9dbc-4de0-8922-6553d6c18dce tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:27.720146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72d4b6c6-9dbc-4de0-8922-6553d6c18dce tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:27.720615 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72d4b6c6-9dbc-4de0-8922-6553d6c18dce tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:27.721037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72d4b6c6-9dbc-4de0-8922-6553d6c18dce tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:27.721711 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72d4b6c6-9dbc-4de0-8922-6553d6c18dce tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:27.722158 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72d4b6c6-9dbc-4de0-8922-6553d6c18dce tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:27.722600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72d4b6c6-9dbc-4de0-8922-6553d6c18dce tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:27.849134 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-72d4b6c6-9dbc-4de0-8922-6553d6c18dce tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:27.857507 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-72d4b6c6-9dbc-4de0-8922-6553d6c18dce tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.148352 Sep 01 16:37:27.858070 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 288/546] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:27 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:27.868443 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-8355df38-93f5-4063-8924-ba410724e824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:27.869071 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-8355df38-93f5-4063-8924-ba410724e824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:27.876160 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8355df38-93f5-4063-8924-ba410724e824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:27.876636 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8355df38-93f5-4063-8924-ba410724e824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:27.877063 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8355df38-93f5-4063-8924-ba410724e824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:27.877734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8355df38-93f5-4063-8924-ba410724e824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:27.878177 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8355df38-93f5-4063-8924-ba410724e824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:27.878618 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8355df38-93f5-4063-8924-ba410724e824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:28.007203 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-8355df38-93f5-4063-8924-ba410724e824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:28.016963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-8355df38-93f5-4063-8924-ba410724e824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:28.018455 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-8355df38-93f5-4063-8924-ba410724e824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:28.019624 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-8355df38-93f5-4063-8924-ba410724e824 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.155017 Sep 01 16:37:28.020172 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 259/547] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:27 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:28.878902 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-83e6e0dc-e795-4766-add6-e71856fe5db0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:28.879506 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-83e6e0dc-e795-4766-add6-e71856fe5db0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:28.886582 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-83e6e0dc-e795-4766-add6-e71856fe5db0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:28.887054 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-83e6e0dc-e795-4766-add6-e71856fe5db0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:28.887479 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-83e6e0dc-e795-4766-add6-e71856fe5db0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:28.888929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-83e6e0dc-e795-4766-add6-e71856fe5db0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:28.889396 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-83e6e0dc-e795-4766-add6-e71856fe5db0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:28.889914 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-83e6e0dc-e795-4766-add6-e71856fe5db0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:29.025676 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-83e6e0dc-e795-4766-add6-e71856fe5db0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:29.029218 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:29.034585 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-83e6e0dc-e795-4766-add6-e71856fe5db0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.159937 Sep 01 16:37:29.035157 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 289/548] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:28 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:29.042821 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a7b7a65e-e4c4-4781-b704-f2bb9c4476e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:29.043519 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a7b7a65e-e4c4-4781-b704-f2bb9c4476e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:29.050411 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a7b7a65e-e4c4-4781-b704-f2bb9c4476e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:29.050892 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a7b7a65e-e4c4-4781-b704-f2bb9c4476e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:29.051321 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a7b7a65e-e4c4-4781-b704-f2bb9c4476e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:29.052088 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a7b7a65e-e4c4-4781-b704-f2bb9c4476e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:29.052539 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a7b7a65e-e4c4-4781-b704-f2bb9c4476e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:29.052963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a7b7a65e-e4c4-4781-b704-f2bb9c4476e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:29.185904 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a7b7a65e-e4c4-4781-b704-f2bb9c4476e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:29.194592 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a7b7a65e-e4c4-4781-b704-f2bb9c4476e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:29.196165 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a7b7a65e-e4c4-4781-b704-f2bb9c4476e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:29.197314 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a7b7a65e-e4c4-4781-b704-f2bb9c4476e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.158710 Sep 01 16:37:29.197865 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 260/549] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:29 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:30.055630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-634b9b37-085b-4bae-bd45-64b570ec32ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:30.056229 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-634b9b37-085b-4bae-bd45-64b570ec32ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:30.063018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-634b9b37-085b-4bae-bd45-64b570ec32ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.063540 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-634b9b37-085b-4bae-bd45-64b570ec32ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.064007 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-634b9b37-085b-4bae-bd45-64b570ec32ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.064703 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-634b9b37-085b-4bae-bd45-64b570ec32ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.065219 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-634b9b37-085b-4bae-bd45-64b570ec32ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.065757 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-634b9b37-085b-4bae-bd45-64b570ec32ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.194050 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-634b9b37-085b-4bae-bd45-64b570ec32ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:30.202439 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-634b9b37-085b-4bae-bd45-64b570ec32ff tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.150930 Sep 01 16:37:30.202999 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 290/550] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:30 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:30.220841 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6cd3e276-26d1-48e1-b9fe-88012f48be83 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:30.221437 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-6cd3e276-26d1-48e1-b9fe-88012f48be83 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:30.228040 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6cd3e276-26d1-48e1-b9fe-88012f48be83 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.228514 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6cd3e276-26d1-48e1-b9fe-88012f48be83 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.228973 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6cd3e276-26d1-48e1-b9fe-88012f48be83 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.229649 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6cd3e276-26d1-48e1-b9fe-88012f48be83 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.230096 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6cd3e276-26d1-48e1-b9fe-88012f48be83 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.230544 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6cd3e276-26d1-48e1-b9fe-88012f48be83 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.359725 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-6cd3e276-26d1-48e1-b9fe-88012f48be83 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:30.368509 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-6cd3e276-26d1-48e1-b9fe-88012f48be83 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:30.370811 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-6cd3e276-26d1-48e1-b9fe-88012f48be83 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:30.371975 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-6cd3e276-26d1-48e1-b9fe-88012f48be83 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.154999 Sep 01 16:37:30.372534 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 261/551] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:30 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:31.223614 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-af3756df-2bd8-4d59-9798-9f3b5e2912d4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:31.224213 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-af3756df-2bd8-4d59-9798-9f3b5e2912d4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:31.231477 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af3756df-2bd8-4d59-9798-9f3b5e2912d4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:31.231945 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af3756df-2bd8-4d59-9798-9f3b5e2912d4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:31.232369 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af3756df-2bd8-4d59-9798-9f3b5e2912d4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:31.233040 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af3756df-2bd8-4d59-9798-9f3b5e2912d4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:31.233500 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af3756df-2bd8-4d59-9798-9f3b5e2912d4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:31.233899 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af3756df-2bd8-4d59-9798-9f3b5e2912d4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:31.367062 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-af3756df-2bd8-4d59-9798-9f3b5e2912d4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:31.374902 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-af3756df-2bd8-4d59-9798-9f3b5e2912d4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.155253 Sep 01 16:37:31.375461 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 291/552] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:31 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:31.394690 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-399f52f1-e1a0-43d9-8367-169eeb43e31e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:31.395291 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-399f52f1-e1a0-43d9-8367-169eeb43e31e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:31.401641 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-399f52f1-e1a0-43d9-8367-169eeb43e31e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:31.402151 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-399f52f1-e1a0-43d9-8367-169eeb43e31e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:31.403143 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-399f52f1-e1a0-43d9-8367-169eeb43e31e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:31.403831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-399f52f1-e1a0-43d9-8367-169eeb43e31e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:31.404283 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-399f52f1-e1a0-43d9-8367-169eeb43e31e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:31.404723 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-399f52f1-e1a0-43d9-8367-169eeb43e31e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:31.422541 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=100 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:31.532122 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-399f52f1-e1a0-43d9-8367-169eeb43e31e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:31.541337 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-399f52f1-e1a0-43d9-8367-169eeb43e31e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:31.542838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-399f52f1-e1a0-43d9-8367-169eeb43e31e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:31.543988 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-399f52f1-e1a0-43d9-8367-169eeb43e31e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.153145 Sep 01 16:37:31.544539 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 262/553] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:31 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:32.396510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1f06be88-1d09-4c26-a109-fcafb84fd89a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:32.397114 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1f06be88-1d09-4c26-a109-fcafb84fd89a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:32.405178 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1f06be88-1d09-4c26-a109-fcafb84fd89a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:32.405649 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1f06be88-1d09-4c26-a109-fcafb84fd89a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:32.406071 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1f06be88-1d09-4c26-a109-fcafb84fd89a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:32.406776 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1f06be88-1d09-4c26-a109-fcafb84fd89a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:32.407221 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1f06be88-1d09-4c26-a109-fcafb84fd89a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:32.407632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1f06be88-1d09-4c26-a109-fcafb84fd89a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:32.540177 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1f06be88-1d09-4c26-a109-fcafb84fd89a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:32.547810 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1f06be88-1d09-4c26-a109-fcafb84fd89a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.155966 Sep 01 16:37:32.548377 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 292/554] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:32 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:32.566904 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-2561307a-6f4f-46ee-a653-688a4bc9d121 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:32.567500 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-2561307a-6f4f-46ee-a653-688a4bc9d121 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:32.573809 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2561307a-6f4f-46ee-a653-688a4bc9d121 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:32.574314 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2561307a-6f4f-46ee-a653-688a4bc9d121 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:32.574741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2561307a-6f4f-46ee-a653-688a4bc9d121 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:32.575412 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2561307a-6f4f-46ee-a653-688a4bc9d121 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:32.576413 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2561307a-6f4f-46ee-a653-688a4bc9d121 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:32.576828 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2561307a-6f4f-46ee-a653-688a4bc9d121 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:32.705391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2561307a-6f4f-46ee-a653-688a4bc9d121 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:32.714781 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2561307a-6f4f-46ee-a653-688a4bc9d121 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:32.716256 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2561307a-6f4f-46ee-a653-688a4bc9d121 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:32.717407 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-2561307a-6f4f-46ee-a653-688a4bc9d121 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.154293 Sep 01 16:37:32.717964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 263/555] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:32 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:33.271063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-ca41e607-9960-4f19-88a0-57dea8ce30bf req-3e49a2fe-ab72-488c-b06c-cc063418a6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de83f04b-508f-4b6f-88da-92857f482014", "name": "network-vif-plugged", "status": "completed", "tag": "9ed23239-98a4-43e2-9a12-3bdb7d38814e"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:33.281975 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-ca41e607-9960-4f19-88a0-57dea8ce30bf req-3e49a2fe-ab72-488c-b06c-cc063418a6f3 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:33.282483 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-ca41e607-9960-4f19-88a0-57dea8ce30bf req-3e49a2fe-ab72-488c-b06c-cc063418a6f3 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:33.282916 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-ca41e607-9960-4f19-88a0-57dea8ce30bf req-3e49a2fe-ab72-488c-b06c-cc063418a6f3 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:33.295556 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-ca41e607-9960-4f19-88a0-57dea8ce30bf req-3e49a2fe-ab72-488c-b06c-cc063418a6f3 service nova] Creating event network-vif-plugged:9ed23239-98a4-43e2-9a12-3bdb7d38814e for instance de83f04b-508f-4b6f-88da-92857f482014 on hv-cinder-85220 Sep 01 16:37:33.300739 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-ca41e607-9960-4f19-88a0-57dea8ce30bf req-3e49a2fe-ab72-488c-b06c-cc063418a6f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033976 Sep 01 16:37:33.301374 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 293/556] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:33.569053 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ee6979be-9aad-4a0b-ba44-0a3430a84908 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:33.569649 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ee6979be-9aad-4a0b-ba44-0a3430a84908 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:33.576159 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee6979be-9aad-4a0b-ba44-0a3430a84908 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:33.576627 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee6979be-9aad-4a0b-ba44-0a3430a84908 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:33.577054 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee6979be-9aad-4a0b-ba44-0a3430a84908 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:33.577725 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee6979be-9aad-4a0b-ba44-0a3430a84908 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:33.578168 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee6979be-9aad-4a0b-ba44-0a3430a84908 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:33.578614 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee6979be-9aad-4a0b-ba44-0a3430a84908 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:33.713846 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ee6979be-9aad-4a0b-ba44-0a3430a84908 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:33.722142 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ee6979be-9aad-4a0b-ba44-0a3430a84908 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.156991 Sep 01 16:37:33.722952 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 264/557] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:33 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:33.742788 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-aefaaa98-cb01-46de-920a-6f63703e1ab1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:33.744302 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-aefaaa98-cb01-46de-920a-6f63703e1ab1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:33.753335 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aefaaa98-cb01-46de-920a-6f63703e1ab1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:33.753816 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aefaaa98-cb01-46de-920a-6f63703e1ab1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:33.754359 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aefaaa98-cb01-46de-920a-6f63703e1ab1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:33.754953 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aefaaa98-cb01-46de-920a-6f63703e1ab1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:33.755394 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aefaaa98-cb01-46de-920a-6f63703e1ab1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:33.755806 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aefaaa98-cb01-46de-920a-6f63703e1ab1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:33.902204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-aefaaa98-cb01-46de-920a-6f63703e1ab1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:33.911417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-aefaaa98-cb01-46de-920a-6f63703e1ab1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:33.912841 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-aefaaa98-cb01-46de-920a-6f63703e1ab1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:33.913979 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-aefaaa98-cb01-46de-920a-6f63703e1ab1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.176000 Sep 01 16:37:33.914561 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 294/558] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:33 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:34.742982 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-338df7c4-c06b-4729-b832-706cfd5f3c90 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:34.743580 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-338df7c4-c06b-4729-b832-706cfd5f3c90 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:34.750576 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-338df7c4-c06b-4729-b832-706cfd5f3c90 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:34.751049 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-338df7c4-c06b-4729-b832-706cfd5f3c90 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:34.751473 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-338df7c4-c06b-4729-b832-706cfd5f3c90 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:34.752149 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-338df7c4-c06b-4729-b832-706cfd5f3c90 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:34.752591 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-338df7c4-c06b-4729-b832-706cfd5f3c90 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:34.753008 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-338df7c4-c06b-4729-b832-706cfd5f3c90 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:34.884128 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-338df7c4-c06b-4729-b832-706cfd5f3c90 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:34.892358 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-338df7c4-c06b-4729-b832-706cfd5f3c90 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.153204 Sep 01 16:37:34.892918 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 265/559] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:34 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:34.937367 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a2ceff26-1205-4736-afe0-c926cf664a00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:34.937888 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a2ceff26-1205-4736-afe0-c926cf664a00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:34.944313 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2ceff26-1205-4736-afe0-c926cf664a00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:34.944793 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2ceff26-1205-4736-afe0-c926cf664a00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:34.945224 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2ceff26-1205-4736-afe0-c926cf664a00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:34.945909 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2ceff26-1205-4736-afe0-c926cf664a00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:34.946389 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2ceff26-1205-4736-afe0-c926cf664a00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:34.946812 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2ceff26-1205-4736-afe0-c926cf664a00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:35.076391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a2ceff26-1205-4736-afe0-c926cf664a00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:35.084770 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a2ceff26-1205-4736-afe0-c926cf664a00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:35.086194 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a2ceff26-1205-4736-afe0-c926cf664a00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:35.087383 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a2ceff26-1205-4736-afe0-c926cf664a00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.154520 Sep 01 16:37:35.087943 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 295/560] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:34 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:35.912994 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-68ced0f9-7cdc-4746-9f2c-4e707601cad4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:35.913607 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-68ced0f9-7cdc-4746-9f2c-4e707601cad4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:35.916017 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:35.921269 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-68ced0f9-7cdc-4746-9f2c-4e707601cad4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:35.921751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-68ced0f9-7cdc-4746-9f2c-4e707601cad4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:35.922183 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-68ced0f9-7cdc-4746-9f2c-4e707601cad4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:35.922901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-68ced0f9-7cdc-4746-9f2c-4e707601cad4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:35.923342 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-68ced0f9-7cdc-4746-9f2c-4e707601cad4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:35.923760 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-68ced0f9-7cdc-4746-9f2c-4e707601cad4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:36.059522 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-68ced0f9-7cdc-4746-9f2c-4e707601cad4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:36.071324 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-68ced0f9-7cdc-4746-9f2c-4e707601cad4 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.162187 Sep 01 16:37:36.071879 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 266/561] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:35 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:36.110494 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-146899e9-4cfd-4b50-a3fe-cfa4357c795a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:36.111094 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-146899e9-4cfd-4b50-a3fe-cfa4357c795a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:36.117353 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-146899e9-4cfd-4b50-a3fe-cfa4357c795a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:36.117856 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-146899e9-4cfd-4b50-a3fe-cfa4357c795a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:36.118306 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-146899e9-4cfd-4b50-a3fe-cfa4357c795a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:36.119033 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-146899e9-4cfd-4b50-a3fe-cfa4357c795a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:36.119473 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-146899e9-4cfd-4b50-a3fe-cfa4357c795a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:36.119885 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-146899e9-4cfd-4b50-a3fe-cfa4357c795a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:36.246671 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-146899e9-4cfd-4b50-a3fe-cfa4357c795a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:36.255718 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-146899e9-4cfd-4b50-a3fe-cfa4357c795a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:36.257146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-146899e9-4cfd-4b50-a3fe-cfa4357c795a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:36.258301 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-146899e9-4cfd-4b50-a3fe-cfa4357c795a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.151680 Sep 01 16:37:36.258846 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 296/562] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:36 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:37.092429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-da845a6b-73cb-4b29-84ea-f90cb9445409 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:37.093586 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-da845a6b-73cb-4b29-84ea-f90cb9445409 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:37.099931 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-da845a6b-73cb-4b29-84ea-f90cb9445409 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:37.100415 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-da845a6b-73cb-4b29-84ea-f90cb9445409 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:37.100851 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-da845a6b-73cb-4b29-84ea-f90cb9445409 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:37.101784 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-da845a6b-73cb-4b29-84ea-f90cb9445409 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:37.102231 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-da845a6b-73cb-4b29-84ea-f90cb9445409 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:37.102671 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-da845a6b-73cb-4b29-84ea-f90cb9445409 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:37.234847 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-da845a6b-73cb-4b29-84ea-f90cb9445409 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:37.242497 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-da845a6b-73cb-4b29-84ea-f90cb9445409 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.153868 Sep 01 16:37:37.243062 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 267/563] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:37 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:37.281885 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-824d8dad-7cc9-49df-8e55-5b00b5036ab3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:37.282550 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-824d8dad-7cc9-49df-8e55-5b00b5036ab3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:37.289346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-824d8dad-7cc9-49df-8e55-5b00b5036ab3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:37.289825 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-824d8dad-7cc9-49df-8e55-5b00b5036ab3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:37.290285 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-824d8dad-7cc9-49df-8e55-5b00b5036ab3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:37.290983 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-824d8dad-7cc9-49df-8e55-5b00b5036ab3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:37.291438 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-824d8dad-7cc9-49df-8e55-5b00b5036ab3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:37.291938 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-824d8dad-7cc9-49df-8e55-5b00b5036ab3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:37.425195 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-824d8dad-7cc9-49df-8e55-5b00b5036ab3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:37.433830 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-824d8dad-7cc9-49df-8e55-5b00b5036ab3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:37.435222 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-824d8dad-7cc9-49df-8e55-5b00b5036ab3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:37.436356 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-824d8dad-7cc9-49df-8e55-5b00b5036ab3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.159334 Sep 01 16:37:37.436909 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 297/564] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:37 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:38.263068 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b8f2e939-f1ff-4bda-aec0-6e8b62bf9aa8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:38.263602 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b8f2e939-f1ff-4bda-aec0-6e8b62bf9aa8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:38.269871 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b8f2e939-f1ff-4bda-aec0-6e8b62bf9aa8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:38.270373 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b8f2e939-f1ff-4bda-aec0-6e8b62bf9aa8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:38.270799 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b8f2e939-f1ff-4bda-aec0-6e8b62bf9aa8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:38.271465 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b8f2e939-f1ff-4bda-aec0-6e8b62bf9aa8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:38.271930 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b8f2e939-f1ff-4bda-aec0-6e8b62bf9aa8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:38.272342 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b8f2e939-f1ff-4bda-aec0-6e8b62bf9aa8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:38.404374 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b8f2e939-f1ff-4bda-aec0-6e8b62bf9aa8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:38.412487 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b8f2e939-f1ff-4bda-aec0-6e8b62bf9aa8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.153307 Sep 01 16:37:38.413043 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 268/565] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:38 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:38.458985 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ac0115ae-5190-43f0-8d07-8e2e8b923a1a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:38.459773 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ac0115ae-5190-43f0-8d07-8e2e8b923a1a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:38.466089 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac0115ae-5190-43f0-8d07-8e2e8b923a1a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:38.466603 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac0115ae-5190-43f0-8d07-8e2e8b923a1a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:38.467033 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac0115ae-5190-43f0-8d07-8e2e8b923a1a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:38.467738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac0115ae-5190-43f0-8d07-8e2e8b923a1a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:38.468712 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac0115ae-5190-43f0-8d07-8e2e8b923a1a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:38.469129 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac0115ae-5190-43f0-8d07-8e2e8b923a1a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:38.602798 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ac0115ae-5190-43f0-8d07-8e2e8b923a1a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:38.612211 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ac0115ae-5190-43f0-8d07-8e2e8b923a1a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:38.613644 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ac0115ae-5190-43f0-8d07-8e2e8b923a1a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:38.614855 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ac0115ae-5190-43f0-8d07-8e2e8b923a1a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.159734 Sep 01 16:37:38.615411 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 298/566] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:38 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:39.432574 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-2762c3a3-9618-4aac-a5bc-9c42a8073d56 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:39.433142 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-2762c3a3-9618-4aac-a5bc-9c42a8073d56 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:39.439629 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2762c3a3-9618-4aac-a5bc-9c42a8073d56 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:39.440108 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2762c3a3-9618-4aac-a5bc-9c42a8073d56 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:39.440540 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2762c3a3-9618-4aac-a5bc-9c42a8073d56 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:39.441225 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2762c3a3-9618-4aac-a5bc-9c42a8073d56 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:39.441666 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2762c3a3-9618-4aac-a5bc-9c42a8073d56 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:39.442112 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2762c3a3-9618-4aac-a5bc-9c42a8073d56 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:39.572691 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2762c3a3-9618-4aac-a5bc-9c42a8073d56 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:39.581308 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-2762c3a3-9618-4aac-a5bc-9c42a8073d56 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.152611 Sep 01 16:37:39.581870 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 269/567] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:39 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:39.637339 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8cf9cf1c-eb51-4607-adf9-48d1c169ae07 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:39.637931 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8cf9cf1c-eb51-4607-adf9-48d1c169ae07 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:39.644518 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8cf9cf1c-eb51-4607-adf9-48d1c169ae07 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:39.644985 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8cf9cf1c-eb51-4607-adf9-48d1c169ae07 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:39.645407 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8cf9cf1c-eb51-4607-adf9-48d1c169ae07 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:39.646076 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8cf9cf1c-eb51-4607-adf9-48d1c169ae07 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:39.646553 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8cf9cf1c-eb51-4607-adf9-48d1c169ae07 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:39.646964 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8cf9cf1c-eb51-4607-adf9-48d1c169ae07 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:39.775868 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8cf9cf1c-eb51-4607-adf9-48d1c169ae07 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:39.786446 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8cf9cf1c-eb51-4607-adf9-48d1c169ae07 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:39.787888 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8cf9cf1c-eb51-4607-adf9-48d1c169ae07 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:39.789016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8cf9cf1c-eb51-4607-adf9-48d1c169ae07 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.155522 Sep 01 16:37:39.789568 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 299/568] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:39 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:40.603017 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-54f475fc-bb40-4f8d-a674-404bbe2a4661 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:40.603613 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-54f475fc-bb40-4f8d-a674-404bbe2a4661 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:40.609954 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-54f475fc-bb40-4f8d-a674-404bbe2a4661 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:40.610458 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-54f475fc-bb40-4f8d-a674-404bbe2a4661 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:40.610891 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-54f475fc-bb40-4f8d-a674-404bbe2a4661 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:40.611566 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-54f475fc-bb40-4f8d-a674-404bbe2a4661 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:40.612012 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-54f475fc-bb40-4f8d-a674-404bbe2a4661 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:40.612433 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-54f475fc-bb40-4f8d-a674-404bbe2a4661 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:40.743757 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-54f475fc-bb40-4f8d-a674-404bbe2a4661 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:40.751897 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-54f475fc-bb40-4f8d-a674-404bbe2a4661 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1266 microversion: 2.1 time: 0.153010 Sep 01 16:37:40.752459 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 270/569] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:40 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:40.811355 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-92a1bc67-c379-43d0-8729-dcb595b4005d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:40.811980 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-92a1bc67-c379-43d0-8729-dcb595b4005d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:40.819086 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92a1bc67-c379-43d0-8729-dcb595b4005d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:40.819562 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92a1bc67-c379-43d0-8729-dcb595b4005d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:40.819986 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92a1bc67-c379-43d0-8729-dcb595b4005d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:40.820696 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92a1bc67-c379-43d0-8729-dcb595b4005d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:40.821149 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92a1bc67-c379-43d0-8729-dcb595b4005d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:40.821565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92a1bc67-c379-43d0-8729-dcb595b4005d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:40.947150 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-92a1bc67-c379-43d0-8729-dcb595b4005d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:40.956353 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-92a1bc67-c379-43d0-8729-dcb595b4005d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:40.957793 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-92a1bc67-c379-43d0-8729-dcb595b4005d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:40.958972 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-92a1bc67-c379-43d0-8729-dcb595b4005d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.151463 Sep 01 16:37:40.959544 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 300/570] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:40 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:41.751658 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-282d5bf8-6614-4304-aa3d-60a43f1dba9b req-a7806c86-010d-4fd6-aa1c-591b112644d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0958ba3f-7f1d-4fa1-bff7-4459d3945b6f", "name": "network-vif-plugged", "status": "completed", "tag": "46daf8ff-8552-45e4-b4ac-b60b47e199de"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:41.762112 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-282d5bf8-6614-4304-aa3d-60a43f1dba9b req-a7806c86-010d-4fd6-aa1c-591b112644d0 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:41.762615 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-282d5bf8-6614-4304-aa3d-60a43f1dba9b req-a7806c86-010d-4fd6-aa1c-591b112644d0 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:41.763097 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-282d5bf8-6614-4304-aa3d-60a43f1dba9b req-a7806c86-010d-4fd6-aa1c-591b112644d0 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:41.773938 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-adfd0425-14b9-47c4-a5bd-00bc5e115f16 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:41.774557 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-adfd0425-14b9-47c4-a5bd-00bc5e115f16 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:41.776711 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-282d5bf8-6614-4304-aa3d-60a43f1dba9b req-a7806c86-010d-4fd6-aa1c-591b112644d0 service nova] Creating event network-vif-plugged:46daf8ff-8552-45e4-b4ac-b60b47e199de for instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f on hv-cinder-85220 Sep 01 16:37:41.783437 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-282d5bf8-6614-4304-aa3d-60a43f1dba9b req-a7806c86-010d-4fd6-aa1c-591b112644d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035467 Sep 01 16:37:41.784233 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 271/571] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:41.784389 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adfd0425-14b9-47c4-a5bd-00bc5e115f16 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:41.784879 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adfd0425-14b9-47c4-a5bd-00bc5e115f16 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:41.785307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adfd0425-14b9-47c4-a5bd-00bc5e115f16 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:41.786001 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adfd0425-14b9-47c4-a5bd-00bc5e115f16 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:41.786493 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adfd0425-14b9-47c4-a5bd-00bc5e115f16 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:41.786926 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adfd0425-14b9-47c4-a5bd-00bc5e115f16 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:41.916812 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-adfd0425-14b9-47c4-a5bd-00bc5e115f16 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:41.924431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-adfd0425-14b9-47c4-a5bd-00bc5e115f16 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1452 microversion: 2.1 time: 0.155303 Sep 01 16:37:41.924982 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 301/572] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:41 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:41.945501 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-90f706ec-2ab7-407b-83b1-4ce4a5a8884f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:41.946278 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-90f706ec-2ab7-407b-83b1-4ce4a5a8884f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:41.952362 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-90f706ec-2ab7-407b-83b1-4ce4a5a8884f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:41.952835 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-90f706ec-2ab7-407b-83b1-4ce4a5a8884f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:41.953261 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-90f706ec-2ab7-407b-83b1-4ce4a5a8884f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:41.954466 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-90f706ec-2ab7-407b-83b1-4ce4a5a8884f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:41.954908 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-90f706ec-2ab7-407b-83b1-4ce4a5a8884f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:41.955321 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-90f706ec-2ab7-407b-83b1-4ce4a5a8884f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:41.981122 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4d4d8590-9aa8-49a8-a80f-88a9ae653979 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:41.981993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4d4d8590-9aa8-49a8-a80f-88a9ae653979 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:41.988085 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d4d8590-9aa8-49a8-a80f-88a9ae653979 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:41.988583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d4d8590-9aa8-49a8-a80f-88a9ae653979 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:41.988987 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d4d8590-9aa8-49a8-a80f-88a9ae653979 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:41.990000 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d4d8590-9aa8-49a8-a80f-88a9ae653979 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:41.990113 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d4d8590-9aa8-49a8-a80f-88a9ae653979 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:41.990551 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d4d8590-9aa8-49a8-a80f-88a9ae653979 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:42.089168 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-90f706ec-2ab7-407b-83b1-4ce4a5a8884f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:42.097973 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-90f706ec-2ab7-407b-83b1-4ce4a5a8884f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1452 microversion: 2.1 time: 0.157299 Sep 01 16:37:42.098918 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 272/573] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:41 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:42.128860 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4d4d8590-9aa8-49a8-a80f-88a9ae653979 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:42.138081 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4d4d8590-9aa8-49a8-a80f-88a9ae653979 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:42.139643 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4d4d8590-9aa8-49a8-a80f-88a9ae653979 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:42.140787 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4d4d8590-9aa8-49a8-a80f-88a9ae653979 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.163538 Sep 01 16:37:42.142351 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 302/574] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:41 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:43.063011 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d4ac8c7c-02ea-4a52-a25c-0eac9f0cd093 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:43.063580 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d4ac8c7c-02ea-4a52-a25c-0eac9f0cd093 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:43.070333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4ac8c7c-02ea-4a52-a25c-0eac9f0cd093 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:43.070820 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4ac8c7c-02ea-4a52-a25c-0eac9f0cd093 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:43.071249 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4ac8c7c-02ea-4a52-a25c-0eac9f0cd093 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:43.071945 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4ac8c7c-02ea-4a52-a25c-0eac9f0cd093 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:43.072394 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4ac8c7c-02ea-4a52-a25c-0eac9f0cd093 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:43.072818 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4ac8c7c-02ea-4a52-a25c-0eac9f0cd093 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:43.164830 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-69f2d614-f683-4344-aaf6-544a0e5c0c0a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:43.166047 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-69f2d614-f683-4344-aaf6-544a0e5c0c0a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:43.173941 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-69f2d614-f683-4344-aaf6-544a0e5c0c0a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:43.174464 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-69f2d614-f683-4344-aaf6-544a0e5c0c0a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:43.174894 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-69f2d614-f683-4344-aaf6-544a0e5c0c0a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:43.175589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-69f2d614-f683-4344-aaf6-544a0e5c0c0a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:43.176034 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-69f2d614-f683-4344-aaf6-544a0e5c0c0a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:43.176450 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-69f2d614-f683-4344-aaf6-544a0e5c0c0a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:43.201168 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.objects.instance [None req-d4ac8c7c-02ea-4a52-a25c-0eac9f0cd093 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lazy-loading 'services' on Instance uuid f220c0ef-c9c6-4fb0-995b-6daea95e841f {{(pid=127178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:37:43.313170 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-69f2d614-f683-4344-aaf6-544a0e5c0c0a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:43.315511 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d4ac8c7c-02ea-4a52-a25c-0eac9f0cd093 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/os-volume_attachments/c40f8e32-8672-4200-b2b2-99b3c3099117" status: 202 len: 0 microversion: 2.1 time: 0.256321 Sep 01 16:37:43.316102 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 273/575] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 1 16:37:43 2022] DELETE /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/os-volume_attachments/c40f8e32-8672-4200-b2b2-99b3c3099117 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:37:43.331345 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-69f2d614-f683-4344-aaf6-544a0e5c0c0a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:43.332772 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-69f2d614-f683-4344-aaf6-544a0e5c0c0a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:43.334157 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-69f2d614-f683-4344-aaf6-544a0e5c0c0a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.173223 Sep 01 16:37:43.335240 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 303/576] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:43 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:44.171266 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-23a151b0-cd8e-4f28-aa47-2eada99513fb req-727d2687-ccae-42c3-bdc3-101557134667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de83f04b-508f-4b6f-88da-92857f482014", "tag": "9ed23239-98a4-43e2-9a12-3bdb7d38814e"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:44.182015 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-23a151b0-cd8e-4f28-aa47-2eada99513fb req-727d2687-ccae-42c3-bdc3-101557134667 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:44.182515 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-23a151b0-cd8e-4f28-aa47-2eada99513fb req-727d2687-ccae-42c3-bdc3-101557134667 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:44.182940 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-23a151b0-cd8e-4f28-aa47-2eada99513fb req-727d2687-ccae-42c3-bdc3-101557134667 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:44.194383 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-23a151b0-cd8e-4f28-aa47-2eada99513fb req-727d2687-ccae-42c3-bdc3-101557134667 service nova] Creating event network-changed:9ed23239-98a4-43e2-9a12-3bdb7d38814e for instance de83f04b-508f-4b6f-88da-92857f482014 on hv-cinder-85220 Sep 01 16:37:44.199208 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-23a151b0-cd8e-4f28-aa47-2eada99513fb req-727d2687-ccae-42c3-bdc3-101557134667 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032563 Sep 01 16:37:44.199972 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 274/577] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:44.357363 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9ed88053-0272-49c7-b34d-472cb20d7d60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:44.357958 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9ed88053-0272-49c7-b34d-472cb20d7d60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:44.365030 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9ed88053-0272-49c7-b34d-472cb20d7d60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:44.365505 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9ed88053-0272-49c7-b34d-472cb20d7d60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:44.365926 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9ed88053-0272-49c7-b34d-472cb20d7d60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:44.366634 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9ed88053-0272-49c7-b34d-472cb20d7d60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:44.367076 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9ed88053-0272-49c7-b34d-472cb20d7d60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:44.367486 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9ed88053-0272-49c7-b34d-472cb20d7d60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:44.517136 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9ed88053-0272-49c7-b34d-472cb20d7d60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:44.527011 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9ed88053-0272-49c7-b34d-472cb20d7d60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:44.528782 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9ed88053-0272-49c7-b34d-472cb20d7d60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:44.530148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9ed88053-0272-49c7-b34d-472cb20d7d60 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1807 microversion: 2.20 time: 0.176785 Sep 01 16:37:44.550146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 304/578] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:44 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:45.558263 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-1a77dc06-cd90-428e-9a43-c746b5f50571 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:45.558970 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-1a77dc06-cd90-428e-9a43-c746b5f50571 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:45.565944 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1a77dc06-cd90-428e-9a43-c746b5f50571 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:45.566449 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1a77dc06-cd90-428e-9a43-c746b5f50571 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:45.566876 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1a77dc06-cd90-428e-9a43-c746b5f50571 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:45.567549 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1a77dc06-cd90-428e-9a43-c746b5f50571 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:45.568120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1a77dc06-cd90-428e-9a43-c746b5f50571 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:45.568769 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1a77dc06-cd90-428e-9a43-c746b5f50571 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:45.604766 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4249729d-204a-403d-b6e0-dd5035dd03c8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:45.605279 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4249729d-204a-403d-b6e0-dd5035dd03c8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:45.612502 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4249729d-204a-403d-b6e0-dd5035dd03c8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:45.613125 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4249729d-204a-403d-b6e0-dd5035dd03c8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:45.613567 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4249729d-204a-403d-b6e0-dd5035dd03c8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:45.614284 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4249729d-204a-403d-b6e0-dd5035dd03c8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:45.614739 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4249729d-204a-403d-b6e0-dd5035dd03c8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:45.615161 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4249729d-204a-403d-b6e0-dd5035dd03c8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:45.746709 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-4249729d-204a-403d-b6e0-dd5035dd03c8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lazy-loading 'services' on Instance uuid 1fa20f73-9965-4f95-b7a9-7d98e3822024 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:37:45.788625 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-1a77dc06-cd90-428e-9a43-c746b5f50571 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:45.799991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-1a77dc06-cd90-428e-9a43-c746b5f50571 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:45.801527 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-1a77dc06-cd90-428e-9a43-c746b5f50571 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:45.803121 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-1a77dc06-cd90-428e-9a43-c746b5f50571 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1794 microversion: 2.20 time: 0.249802 Sep 01 16:37:45.804214 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 275/579] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:45 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1794 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:45.892616 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4249729d-204a-403d-b6e0-dd5035dd03c8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024/os-volume_attachments/81b8e388-cfe2-4a70-91ac-d8aed3cd0b02" status: 202 len: 0 microversion: 2.1 time: 0.291960 Sep 01 16:37:45.893324 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 305/580] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 1 16:37:45 2022] DELETE /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024/os-volume_attachments/81b8e388-cfe2-4a70-91ac-d8aed3cd0b02 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:37:46.580805 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-23f421cb-8439-431c-95ee-62014703ce29 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:46.587472 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-23f421cb-8439-431c-95ee-62014703ce29 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:46.588019 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-23f421cb-8439-431c-95ee-62014703ce29 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:46.588454 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-23f421cb-8439-431c-95ee-62014703ce29 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:46.611194 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-23f421cb-8439-431c-95ee-62014703ce29 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Going to try to stop instance {{(pid=127178) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 16:37:46.655647 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-23f421cb-8439-431c-95ee-62014703ce29 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "POST /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/action" status: 202 len: 0 microversion: 2.1 time: 0.078910 Sep 01 16:37:46.656162 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 276/581] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 1 16:37:46 2022] POST /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:37:46.665717 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b67751f2-91d2-4045-9a90-d535d2e072ac tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:46.666551 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b67751f2-91d2-4045-9a90-d535d2e072ac tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:46.674875 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b67751f2-91d2-4045-9a90-d535d2e072ac tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:46.675429 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b67751f2-91d2-4045-9a90-d535d2e072ac tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:46.675921 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b67751f2-91d2-4045-9a90-d535d2e072ac tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:46.676734 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b67751f2-91d2-4045-9a90-d535d2e072ac tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:46.677262 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b67751f2-91d2-4045-9a90-d535d2e072ac tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:46.678066 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b67751f2-91d2-4045-9a90-d535d2e072ac tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:46.697883 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:46.811333 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b67751f2-91d2-4045-9a90-d535d2e072ac tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:46.819695 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b67751f2-91d2-4045-9a90-d535d2e072ac tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1676 microversion: 2.1 time: 0.158656 Sep 01 16:37:46.820263 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 306/582] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:46 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:47.020595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-976fd384-8339-48a6-92d3-4eb2d84b23f4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:47.021181 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-976fd384-8339-48a6-92d3-4eb2d84b23f4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:47.027350 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-976fd384-8339-48a6-92d3-4eb2d84b23f4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:47.027831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-976fd384-8339-48a6-92d3-4eb2d84b23f4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:47.028298 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-976fd384-8339-48a6-92d3-4eb2d84b23f4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:47.028987 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-976fd384-8339-48a6-92d3-4eb2d84b23f4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:47.029439 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-976fd384-8339-48a6-92d3-4eb2d84b23f4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:47.029864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-976fd384-8339-48a6-92d3-4eb2d84b23f4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:47.067315 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-976fd384-8339-48a6-92d3-4eb2d84b23f4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Going to try to terminate instance {{(pid=127178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:37:47.103335 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:47.153883 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-976fd384-8339-48a6-92d3-4eb2d84b23f4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 204 len: 0 microversion: 2.1 time: 0.138369 Sep 01 16:37:47.154713 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 277/583] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:37:47 2022] DELETE /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:37:47.163997 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a51caf19-694c-4fbc-a1ee-3f087ae11ede tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:47.164601 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a51caf19-694c-4fbc-a1ee-3f087ae11ede tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:47.166431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=56 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:47.171735 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a51caf19-694c-4fbc-a1ee-3f087ae11ede tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:47.172707 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a51caf19-694c-4fbc-a1ee-3f087ae11ede tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:47.173133 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a51caf19-694c-4fbc-a1ee-3f087ae11ede tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:47.173808 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a51caf19-694c-4fbc-a1ee-3f087ae11ede tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:47.174268 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a51caf19-694c-4fbc-a1ee-3f087ae11ede tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:47.174684 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a51caf19-694c-4fbc-a1ee-3f087ae11ede tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:47.304082 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a51caf19-694c-4fbc-a1ee-3f087ae11ede tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:47.311690 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a51caf19-694c-4fbc-a1ee-3f087ae11ede tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1514 microversion: 2.1 time: 0.151574 Sep 01 16:37:47.312258 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 307/584] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:47 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:47.841305 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-14249737-2031-488c-a62e-bd83d3aa0158 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:47.841983 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-14249737-2031-488c-a62e-bd83d3aa0158 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:47.848949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-14249737-2031-488c-a62e-bd83d3aa0158 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:47.849415 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-14249737-2031-488c-a62e-bd83d3aa0158 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:47.849835 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-14249737-2031-488c-a62e-bd83d3aa0158 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:47.850542 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-14249737-2031-488c-a62e-bd83d3aa0158 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:47.851243 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-14249737-2031-488c-a62e-bd83d3aa0158 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:47.851651 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-14249737-2031-488c-a62e-bd83d3aa0158 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:47.978173 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-14249737-2031-488c-a62e-bd83d3aa0158 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:47.985748 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-14249737-2031-488c-a62e-bd83d3aa0158 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1676 microversion: 2.1 time: 0.148659 Sep 01 16:37:47.986323 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 278/585] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:47 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:48.333553 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7444f19e-801d-4d15-b75f-f36460c27214 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:48.334304 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7444f19e-801d-4d15-b75f-f36460c27214 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:48.340801 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7444f19e-801d-4d15-b75f-f36460c27214 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:48.341306 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7444f19e-801d-4d15-b75f-f36460c27214 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:48.341823 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7444f19e-801d-4d15-b75f-f36460c27214 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:48.342552 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7444f19e-801d-4d15-b75f-f36460c27214 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:48.342993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7444f19e-801d-4d15-b75f-f36460c27214 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:48.343409 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7444f19e-801d-4d15-b75f-f36460c27214 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:48.473819 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7444f19e-801d-4d15-b75f-f36460c27214 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:48.481986 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7444f19e-801d-4d15-b75f-f36460c27214 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1514 microversion: 2.1 time: 0.152414 Sep 01 16:37:48.482605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 308/586] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:48 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:49.006739 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-92f96e4e-fc28-4b1c-bcf6-333b2fd2e984 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:49.007248 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-92f96e4e-fc28-4b1c-bcf6-333b2fd2e984 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:49.013646 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-92f96e4e-fc28-4b1c-bcf6-333b2fd2e984 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:49.014118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-92f96e4e-fc28-4b1c-bcf6-333b2fd2e984 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:49.014574 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-92f96e4e-fc28-4b1c-bcf6-333b2fd2e984 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:49.015248 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-92f96e4e-fc28-4b1c-bcf6-333b2fd2e984 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:49.015688 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-92f96e4e-fc28-4b1c-bcf6-333b2fd2e984 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:49.016118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-92f96e4e-fc28-4b1c-bcf6-333b2fd2e984 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:49.216048 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-92f96e4e-fc28-4b1c-bcf6-333b2fd2e984 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:49.224336 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-92f96e4e-fc28-4b1c-bcf6-333b2fd2e984 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1676 microversion: 2.1 time: 0.221528 Sep 01 16:37:49.224985 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 279/587] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:49 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1676 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:49.506724 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f7b9fcf5-be9b-4f95-85d0-8ab0af3ce581 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:49.507438 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f7b9fcf5-be9b-4f95-85d0-8ab0af3ce581 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:49.514122 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7b9fcf5-be9b-4f95-85d0-8ab0af3ce581 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:49.514635 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7b9fcf5-be9b-4f95-85d0-8ab0af3ce581 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:49.515068 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7b9fcf5-be9b-4f95-85d0-8ab0af3ce581 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:49.516264 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7b9fcf5-be9b-4f95-85d0-8ab0af3ce581 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:49.516720 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7b9fcf5-be9b-4f95-85d0-8ab0af3ce581 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:49.520636 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7b9fcf5-be9b-4f95-85d0-8ab0af3ce581 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:49.573739 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-1966fcfc-4c30-43c7-9491-75f5f6cc0b17 req-f5440548-0939-407c-9733-5f9afe908200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa20f73-9965-4f95-b7a9-7d98e3822024", "name": "network-vif-deleted", "tag": "896672fd-654c-408f-bad2-1993fb22ba9a"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:49.584047 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-1966fcfc-4c30-43c7-9491-75f5f6cc0b17 req-f5440548-0939-407c-9733-5f9afe908200 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:49.584514 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-1966fcfc-4c30-43c7-9491-75f5f6cc0b17 req-f5440548-0939-407c-9733-5f9afe908200 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:49.585475 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-1966fcfc-4c30-43c7-9491-75f5f6cc0b17 req-f5440548-0939-407c-9733-5f9afe908200 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:49.588062 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f7b9fcf5-be9b-4f95-85d0-8ab0af3ce581 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:49.596914 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-1966fcfc-4c30-43c7-9491-75f5f6cc0b17 req-f5440548-0939-407c-9733-5f9afe908200 service nova] Creating event network-vif-deleted:896672fd-654c-408f-bad2-1993fb22ba9a for instance 1fa20f73-9965-4f95-b7a9-7d98e3822024 on hv-cinder-85220 Sep 01 16:37:49.597462 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f7b9fcf5-be9b-4f95-85d0-8ab0af3ce581 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 200 len: 1472 microversion: 2.1 time: 0.095091 Sep 01 16:37:49.598211 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 309/588] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:49 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 1472 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:49.602613 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-1966fcfc-4c30-43c7-9491-75f5f6cc0b17 req-f5440548-0939-407c-9733-5f9afe908200 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032446 Sep 01 16:37:49.603361 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 280/589] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:37:50.246574 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-01a08de6-2da7-4fd6-86b5-edc8d8c3ee4b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:50.247277 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-01a08de6-2da7-4fd6-86b5-edc8d8c3ee4b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:50.253715 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01a08de6-2da7-4fd6-86b5-edc8d8c3ee4b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:50.254181 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01a08de6-2da7-4fd6-86b5-edc8d8c3ee4b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:50.254631 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01a08de6-2da7-4fd6-86b5-edc8d8c3ee4b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:50.255307 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01a08de6-2da7-4fd6-86b5-edc8d8c3ee4b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:50.255767 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01a08de6-2da7-4fd6-86b5-edc8d8c3ee4b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:50.256164 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01a08de6-2da7-4fd6-86b5-edc8d8c3ee4b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:50.388660 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-01a08de6-2da7-4fd6-86b5-edc8d8c3ee4b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:50.396376 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-01a08de6-2da7-4fd6-86b5-edc8d8c3ee4b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1676 microversion: 2.1 time: 0.153573 Sep 01 16:37:50.397370 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 310/590] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:50 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:50.619183 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7900107c-e260-4fda-a891-cc4a755fbd59 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:50.619895 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7900107c-e260-4fda-a891-cc4a755fbd59 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: 1fa20f73-9965-4f95-b7a9-7d98e3822024] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:50.625942 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7900107c-e260-4fda-a891-cc4a755fbd59 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:50.626452 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7900107c-e260-4fda-a891-cc4a755fbd59 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:50.626927 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7900107c-e260-4fda-a891-cc4a755fbd59 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:50.627603 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7900107c-e260-4fda-a891-cc4a755fbd59 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:50.628043 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7900107c-e260-4fda-a891-cc4a755fbd59 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:50.628458 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7900107c-e260-4fda-a891-cc4a755fbd59 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:50.641273 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-7900107c-e260-4fda-a891-cc4a755fbd59 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] HTTP exception thrown: Instance 1fa20f73-9965-4f95-b7a9-7d98e3822024 could not be found. Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7900107c-e260-4fda-a891-cc4a755fbd59 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Request method failure captured: Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 HTTP/1.1 Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN914kSPfu6jrQMCy5l54o1wMkSQWB7fYGgK_n7G8ZFI0L_mFmg_KFP5A9yyubVELpKasNPOCjH-Z6wydzob6AwJnkYwuV94LVYHKZQs1ZgpwmKlYTK0jgvLoOX_WAvTIfa2irhJ2ycyKyy_R9D4K7lmRIUzrB1SpHEJcuXJ1S1zbro Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: 09b1f2c2ff4e4338acd2a3367a4fdee5 Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-VolumesSnapshotTestJSON-193016146 Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:37:50.642880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:37:50.644422 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/09b1f2c2ff4e4338acd2a3367a4fdee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_09b1f2c2ff4e4338acd2a3367a4fdee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/09b1f2c2ff4e4338acd2a3367a4fdee5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/09b1f2c2ff4e4338acd2a3367a4fdee5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:37:50.644422 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-VolumesSnapshotTestJSON-193016146 Sep 01 16:37:50.644422 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: 09b1f2c2ff4e4338acd2a3367a4fdee5 Sep 01 16:37:50.644422 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-193016146 Sep 01 16:37:50.644422 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-VolumesSnapshotTestJSON-193016146-project Sep 01 16:37:50.644422 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:37:50.644422 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:37:50.644422 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: b4d4d3b4817e499196e01d1df96b4775 Sep 01 16:37:50.644422 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-VolumesSnapshotTestJSON-193016146-project Sep 01 16:37:50.644422 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:37:50.644422 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance 1fa20f73-9965-4f95-b7a9-7d98e3822024 could not be found. Sep 01 16:37:50.644422 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': '1fa20f73-9965-4f95-b7a9-7d98e3822024'} Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fa20f73-9965-4f95-b7a9-7d98e3822024 could not be found. Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:37:50.645211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fa20f73-9965-4f95-b7a9-7d98e3822024 could not be found. Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fa20f73-9965-4f95-b7a9-7d98e3822024 could not be found. Sep 01 16:37:50.646429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:37:50.647604 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7900107c-e260-4fda-a891-cc4a755fbd59 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Returning 404 to user: Instance 1fa20f73-9965-4f95-b7a9-7d98e3822024 could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:37:50.647604 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7900107c-e260-4fda-a891-cc4a755fbd59 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024" status: 404 len: 111 microversion: 2.1 time: 0.029703 Sep 01 16:37:50.647604 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 281/591] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:50 2022] GET /compute/v2.1/servers/1fa20f73-9965-4f95-b7a9-7d98e3822024 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:37:51.418049 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0aec00f1-171d-4775-aba7-a54b3b5ae75d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:51.418747 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0aec00f1-171d-4775-aba7-a54b3b5ae75d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:51.426447 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0aec00f1-171d-4775-aba7-a54b3b5ae75d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:51.426917 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0aec00f1-171d-4775-aba7-a54b3b5ae75d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:51.427337 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0aec00f1-171d-4775-aba7-a54b3b5ae75d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:51.428012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0aec00f1-171d-4775-aba7-a54b3b5ae75d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:51.428450 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0aec00f1-171d-4775-aba7-a54b3b5ae75d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:51.428948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0aec00f1-171d-4775-aba7-a54b3b5ae75d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:51.560169 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0aec00f1-171d-4775-aba7-a54b3b5ae75d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:51.567921 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0aec00f1-171d-4775-aba7-a54b3b5ae75d tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1676 microversion: 2.1 time: 0.153795 Sep 01 16:37:51.568488 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 311/592] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:51 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:52.589278 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-4ece3cbf-5921-4333-a228-ccd8900673ea tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:52.589919 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-4ece3cbf-5921-4333-a228-ccd8900673ea tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:52.597087 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4ece3cbf-5921-4333-a228-ccd8900673ea tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:52.597562 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4ece3cbf-5921-4333-a228-ccd8900673ea tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:52.597993 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4ece3cbf-5921-4333-a228-ccd8900673ea tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:52.598696 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4ece3cbf-5921-4333-a228-ccd8900673ea tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:52.599143 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4ece3cbf-5921-4333-a228-ccd8900673ea tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:52.599558 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4ece3cbf-5921-4333-a228-ccd8900673ea tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:52.729660 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-4ece3cbf-5921-4333-a228-ccd8900673ea tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:52.737986 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-4ece3cbf-5921-4333-a228-ccd8900673ea tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1676 microversion: 2.1 time: 0.152588 Sep 01 16:37:52.738572 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 282/593] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:52 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:53.760809 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c2b0a0a1-cda0-4383-8691-6ffa85e8071c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:53.761403 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c2b0a0a1-cda0-4383-8691-6ffa85e8071c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:53.768162 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2b0a0a1-cda0-4383-8691-6ffa85e8071c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:53.768642 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2b0a0a1-cda0-4383-8691-6ffa85e8071c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:53.769072 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2b0a0a1-cda0-4383-8691-6ffa85e8071c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:53.769763 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2b0a0a1-cda0-4383-8691-6ffa85e8071c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:53.770210 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2b0a0a1-cda0-4383-8691-6ffa85e8071c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:53.770650 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2b0a0a1-cda0-4383-8691-6ffa85e8071c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:53.898511 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c2b0a0a1-cda0-4383-8691-6ffa85e8071c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:53.906762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c2b0a0a1-cda0-4383-8691-6ffa85e8071c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1676 microversion: 2.1 time: 0.149563 Sep 01 16:37:53.907304 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 312/594] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:53 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:54.929018 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-5c3ae8a2-78ff-40e2-bb73-eebe790fd45b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:54.929598 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-5c3ae8a2-78ff-40e2-bb73-eebe790fd45b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:54.936224 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5c3ae8a2-78ff-40e2-bb73-eebe790fd45b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:54.936779 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5c3ae8a2-78ff-40e2-bb73-eebe790fd45b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:54.937212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5c3ae8a2-78ff-40e2-bb73-eebe790fd45b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:54.937891 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5c3ae8a2-78ff-40e2-bb73-eebe790fd45b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:54.938368 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5c3ae8a2-78ff-40e2-bb73-eebe790fd45b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:54.938812 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5c3ae8a2-78ff-40e2-bb73-eebe790fd45b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:55.067190 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-5c3ae8a2-78ff-40e2-bb73-eebe790fd45b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:55.075056 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-5c3ae8a2-78ff-40e2-bb73-eebe790fd45b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1676 microversion: 2.1 time: 0.150093 Sep 01 16:37:55.075679 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 283/595] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:54 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:56.096140 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-778a2968-d629-4c47-be21-f87902e579d9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:56.096751 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-778a2968-d629-4c47-be21-f87902e579d9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:56.103985 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-778a2968-d629-4c47-be21-f87902e579d9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:56.104455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-778a2968-d629-4c47-be21-f87902e579d9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:56.104878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-778a2968-d629-4c47-be21-f87902e579d9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:56.105548 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-778a2968-d629-4c47-be21-f87902e579d9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:56.105986 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-778a2968-d629-4c47-be21-f87902e579d9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:56.106427 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-778a2968-d629-4c47-be21-f87902e579d9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:56.233850 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-778a2968-d629-4c47-be21-f87902e579d9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:56.241448 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-778a2968-d629-4c47-be21-f87902e579d9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1676 microversion: 2.1 time: 0.149168 Sep 01 16:37:56.242011 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 313/596] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:56 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:57.262219 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d33db498-925f-43f7-b18a-d745d77ffda4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:57.262862 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d33db498-925f-43f7-b18a-d745d77ffda4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:57.269349 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d33db498-925f-43f7-b18a-d745d77ffda4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:57.269825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d33db498-925f-43f7-b18a-d745d77ffda4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:57.270273 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d33db498-925f-43f7-b18a-d745d77ffda4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:57.270949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d33db498-925f-43f7-b18a-d745d77ffda4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:57.271393 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d33db498-925f-43f7-b18a-d745d77ffda4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:57.271812 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d33db498-925f-43f7-b18a-d745d77ffda4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:57.403590 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d33db498-925f-43f7-b18a-d745d77ffda4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:57.411838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d33db498-925f-43f7-b18a-d745d77ffda4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1676 microversion: 2.1 time: 0.153476 Sep 01 16:37:57.412396 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 284/597] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:57 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:58.434064 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-922118d6-2bcc-4399-9a0a-eaa1fd665b67 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:58.434688 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-922118d6-2bcc-4399-9a0a-eaa1fd665b67 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:58.441341 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-922118d6-2bcc-4399-9a0a-eaa1fd665b67 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:58.442391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-922118d6-2bcc-4399-9a0a-eaa1fd665b67 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:58.442824 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-922118d6-2bcc-4399-9a0a-eaa1fd665b67 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:58.443515 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-922118d6-2bcc-4399-9a0a-eaa1fd665b67 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:58.443960 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-922118d6-2bcc-4399-9a0a-eaa1fd665b67 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:58.444401 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-922118d6-2bcc-4399-9a0a-eaa1fd665b67 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:58.536094 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1675688797", "imageRef": "46185d58-0d47-4c97-b590-0f4434aa5c9e", "flavorRef": "452", "networks": [{"uuid": "38acd0bc-b894-4eb9-a8c5-fadf4fec09f0"}]}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:58.579659 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-922118d6-2bcc-4399-9a0a-eaa1fd665b67 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:58.587300 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-922118d6-2bcc-4399-9a0a-eaa1fd665b67 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1676 microversion: 2.1 time: 0.157141 Sep 01 16:37:58.587864 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 314/598] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:58 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:58.590463 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.network.neutron [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] validate_networks() for [('38acd0bc-b894-4eb9-a8c5-fadf4fec09f0', None, None, None, None, None)] {{(pid=127178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:37:58.932998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Flavor limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:37:58.933414 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Image limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:37:58.933875 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Flavor pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:37:58.934300 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Image pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:37:58.934703 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:37:58.943339 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:58.943805 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:58.944227 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:58.944934 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:58.945374 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:58.945785 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:58.962313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Getting quotas for project 09b1f2c2ff4e4338acd2a3367a4fdee5. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:37:58.966412 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Getting quotas for user b4d4d3b4817e499196e01d1df96b4775 and project 09b1f2c2ff4e4338acd2a3367a4fdee5. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:37:58.977925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Going to run 1 instances... {{(pid=127178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:37:58.980202 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46185d58-0d47-4c97-b590-0f4434aa5c9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:37:59.023867 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ab2a3ed3-e9b2-4447-8215-63ac2e1670f9 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492087 Sep 01 16:37:59.024505 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 285/599] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:37:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 16:37:59.035377 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f5b75df8-c5c9-4d64-8312-5345c0e19a64 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:59.036565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f5b75df8-c5c9-4d64-8312-5345c0e19a64 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:59.091022 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f5b75df8-c5c9-4d64-8312-5345c0e19a64 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:59.097929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f5b75df8-c5c9-4d64-8312-5345c0e19a64 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 200 len: 1219 microversion: 2.1 time: 0.066483 Sep 01 16:37:59.099117 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 315/600] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:59 2022] GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:59.609441 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b68b558e-cf84-429f-a170-e2ded71783e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:59.610046 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b68b558e-cf84-429f-a170-e2ded71783e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:59.616982 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b68b558e-cf84-429f-a170-e2ded71783e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:59.617465 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b68b558e-cf84-429f-a170-e2ded71783e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:59.617980 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b68b558e-cf84-429f-a170-e2ded71783e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:59.618698 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b68b558e-cf84-429f-a170-e2ded71783e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:59.619148 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b68b558e-cf84-429f-a170-e2ded71783e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:59.619566 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b68b558e-cf84-429f-a170-e2ded71783e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:59.750084 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b68b558e-cf84-429f-a170-e2ded71783e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:59.758308 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b68b558e-cf84-429f-a170-e2ded71783e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1676 microversion: 2.1 time: 0.153293 Sep 01 16:37:59.758867 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 286/601] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:59 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:00.119315 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3aff03ec-65c5-417c-b197-c193f9d61c99 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:00.119830 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3aff03ec-65c5-417c-b197-c193f9d61c99 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:00.126266 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3aff03ec-65c5-417c-b197-c193f9d61c99 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:00.126857 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3aff03ec-65c5-417c-b197-c193f9d61c99 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:00.127176 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3aff03ec-65c5-417c-b197-c193f9d61c99 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:00.127933 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3aff03ec-65c5-417c-b197-c193f9d61c99 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:00.128391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3aff03ec-65c5-417c-b197-c193f9d61c99 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:00.128807 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3aff03ec-65c5-417c-b197-c193f9d61c99 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:00.190701 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3aff03ec-65c5-417c-b197-c193f9d61c99 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:00.198984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3aff03ec-65c5-417c-b197-c193f9d61c99 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 200 len: 1271 microversion: 2.1 time: 0.084080 Sep 01 16:38:00.199551 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 316/602] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:00 2022] GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:00.779220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f8177924-f810-4ed5-ae96-4231eb97ac45 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:00.779824 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f8177924-f810-4ed5-ae96-4231eb97ac45 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:00.786640 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f8177924-f810-4ed5-ae96-4231eb97ac45 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:00.787119 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f8177924-f810-4ed5-ae96-4231eb97ac45 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:00.788179 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f8177924-f810-4ed5-ae96-4231eb97ac45 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:00.788868 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f8177924-f810-4ed5-ae96-4231eb97ac45 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:00.789313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f8177924-f810-4ed5-ae96-4231eb97ac45 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:00.789731 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f8177924-f810-4ed5-ae96-4231eb97ac45 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:00.972237 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f8177924-f810-4ed5-ae96-4231eb97ac45 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:00.980844 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f8177924-f810-4ed5-ae96-4231eb97ac45 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1676 microversion: 2.1 time: 0.205448 Sep 01 16:38:00.981510 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 287/603] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:00 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:01.219483 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0fec4395-fa0a-483f-97a5-b2dc17292b04 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:01.220095 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0fec4395-fa0a-483f-97a5-b2dc17292b04 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:01.227456 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fec4395-fa0a-483f-97a5-b2dc17292b04 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:01.227942 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fec4395-fa0a-483f-97a5-b2dc17292b04 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:01.228372 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fec4395-fa0a-483f-97a5-b2dc17292b04 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:01.229093 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fec4395-fa0a-483f-97a5-b2dc17292b04 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:01.229550 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fec4395-fa0a-483f-97a5-b2dc17292b04 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:01.229969 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fec4395-fa0a-483f-97a5-b2dc17292b04 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:01.360482 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0fec4395-fa0a-483f-97a5-b2dc17292b04 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:01.368884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0fec4395-fa0a-483f-97a5-b2dc17292b04 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 200 len: 1319 microversion: 2.1 time: 0.153169 Sep 01 16:38:01.369658 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 317/604] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:01 2022] GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:01.811756 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-35c17903-5d98-4906-8185-946035a36f5d req-825b10ad-c465-4447-be51-7cad805eb9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1e61cdb-828c-466f-b7ca-7bbd7df3ea43", "tag": "87981084-4264-485a-8bbe-2a3b814a0390"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:01.822132 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-35c17903-5d98-4906-8185-946035a36f5d req-825b10ad-c465-4447-be51-7cad805eb9b8 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:01.822641 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-35c17903-5d98-4906-8185-946035a36f5d req-825b10ad-c465-4447-be51-7cad805eb9b8 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:01.823060 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-35c17903-5d98-4906-8185-946035a36f5d req-825b10ad-c465-4447-be51-7cad805eb9b8 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:01.833933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-35c17903-5d98-4906-8185-946035a36f5d req-825b10ad-c465-4447-be51-7cad805eb9b8 service nova] Creating event network-changed:87981084-4264-485a-8bbe-2a3b814a0390 for instance e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 on hv-cinder-85220 Sep 01 16:38:01.839140 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-35c17903-5d98-4906-8185-946035a36f5d req-825b10ad-c465-4447-be51-7cad805eb9b8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031051 Sep 01 16:38:01.839792 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 288/605] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:02.001157 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e8016727-9c07-444d-a11a-1e4849dfb1d6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:02.008994 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e8016727-9c07-444d-a11a-1e4849dfb1d6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:02.010060 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8016727-9c07-444d-a11a-1e4849dfb1d6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:02.010654 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8016727-9c07-444d-a11a-1e4849dfb1d6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:02.011171 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8016727-9c07-444d-a11a-1e4849dfb1d6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:02.011971 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8016727-9c07-444d-a11a-1e4849dfb1d6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:02.012415 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8016727-9c07-444d-a11a-1e4849dfb1d6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:02.012826 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8016727-9c07-444d-a11a-1e4849dfb1d6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:02.150933 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e8016727-9c07-444d-a11a-1e4849dfb1d6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:02.158938 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e8016727-9c07-444d-a11a-1e4849dfb1d6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1676 microversion: 2.1 time: 0.161801 Sep 01 16:38:02.159526 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 318/606] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:01 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:02.390059 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f0468e90-7e39-425a-bd81-f6a7ce7c2046 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:02.390875 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f0468e90-7e39-425a-bd81-f6a7ce7c2046 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:02.397114 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f0468e90-7e39-425a-bd81-f6a7ce7c2046 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:02.397674 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f0468e90-7e39-425a-bd81-f6a7ce7c2046 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:02.398173 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f0468e90-7e39-425a-bd81-f6a7ce7c2046 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:02.398944 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f0468e90-7e39-425a-bd81-f6a7ce7c2046 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:02.399465 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f0468e90-7e39-425a-bd81-f6a7ce7c2046 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:02.399955 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f0468e90-7e39-425a-bd81-f6a7ce7c2046 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:02.609966 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f0468e90-7e39-425a-bd81-f6a7ce7c2046 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:02.618322 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f0468e90-7e39-425a-bd81-f6a7ce7c2046 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 200 len: 1319 microversion: 2.1 time: 0.232453 Sep 01 16:38:02.618885 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 289/607] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:02 2022] GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:03.180104 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7d2906ba-23af-4326-acb6-be8215ad28de tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:03.180705 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7d2906ba-23af-4326-acb6-be8215ad28de tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:03.187475 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7d2906ba-23af-4326-acb6-be8215ad28de tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:03.188275 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7d2906ba-23af-4326-acb6-be8215ad28de tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:03.189012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7d2906ba-23af-4326-acb6-be8215ad28de tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:03.189884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7d2906ba-23af-4326-acb6-be8215ad28de tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:03.190362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7d2906ba-23af-4326-acb6-be8215ad28de tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:03.190783 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7d2906ba-23af-4326-acb6-be8215ad28de tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:03.318223 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7d2906ba-23af-4326-acb6-be8215ad28de tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:03.326392 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7d2906ba-23af-4326-acb6-be8215ad28de tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1676 microversion: 2.1 time: 0.150077 Sep 01 16:38:03.326953 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 319/608] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:03 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:03.638974 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-9f46ddd3-20c9-4e96-a683-b871457128c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:03.639555 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-9f46ddd3-20c9-4e96-a683-b871457128c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:03.645864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9f46ddd3-20c9-4e96-a683-b871457128c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:03.646369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9f46ddd3-20c9-4e96-a683-b871457128c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:03.646889 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9f46ddd3-20c9-4e96-a683-b871457128c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:03.647571 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9f46ddd3-20c9-4e96-a683-b871457128c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:03.648021 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9f46ddd3-20c9-4e96-a683-b871457128c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:03.648437 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9f46ddd3-20c9-4e96-a683-b871457128c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:03.775482 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9f46ddd3-20c9-4e96-a683-b871457128c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:03.783039 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-9f46ddd3-20c9-4e96-a683-b871457128c5 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 200 len: 1319 microversion: 2.1 time: 0.147918 Sep 01 16:38:03.783608 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 290/609] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:03 2022] GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:04.347696 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c74d9f0f-cec9-4815-b0e1-4c1b2d424210 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:04.348295 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c74d9f0f-cec9-4815-b0e1-4c1b2d424210 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:04.355586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c74d9f0f-cec9-4815-b0e1-4c1b2d424210 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.356064 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c74d9f0f-cec9-4815-b0e1-4c1b2d424210 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.356492 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c74d9f0f-cec9-4815-b0e1-4c1b2d424210 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:04.357175 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c74d9f0f-cec9-4815-b0e1-4c1b2d424210 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.357615 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c74d9f0f-cec9-4815-b0e1-4c1b2d424210 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.358024 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c74d9f0f-cec9-4815-b0e1-4c1b2d424210 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:04.487902 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c74d9f0f-cec9-4815-b0e1-4c1b2d424210 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:04.495802 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c74d9f0f-cec9-4815-b0e1-4c1b2d424210 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1653 microversion: 2.1 time: 0.151952 Sep 01 16:38:04.496380 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 320/610] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:04 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1653 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:04.516345 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-5636fc5f-0fb2-4430-9fd4-e3ab149fb9b6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:04.522173 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5636fc5f-0fb2-4430-9fd4-e3ab149fb9b6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.522768 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5636fc5f-0fb2-4430-9fd4-e3ab149fb9b6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.523217 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5636fc5f-0fb2-4430-9fd4-e3ab149fb9b6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:04.547727 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-5636fc5f-0fb2-4430-9fd4-e3ab149fb9b6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Going to try to start instance {{(pid=127178) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 16:38:04.592718 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-5636fc5f-0fb2-4430-9fd4-e3ab149fb9b6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "POST /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/action" status: 202 len: 0 microversion: 2.1 time: 0.078511 Sep 01 16:38:04.592718 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 291/611] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 1 16:38:04 2022] POST /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:38:04.600596 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-77c8478b-849d-4254-ac82-1a0a6192fdb4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:04.601211 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-77c8478b-849d-4254-ac82-1a0a6192fdb4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:04.608009 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-77c8478b-849d-4254-ac82-1a0a6192fdb4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.608460 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-77c8478b-849d-4254-ac82-1a0a6192fdb4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.608893 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-77c8478b-849d-4254-ac82-1a0a6192fdb4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:04.609584 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-77c8478b-849d-4254-ac82-1a0a6192fdb4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.610219 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-77c8478b-849d-4254-ac82-1a0a6192fdb4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.610662 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-77c8478b-849d-4254-ac82-1a0a6192fdb4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:04.747287 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-77c8478b-849d-4254-ac82-1a0a6192fdb4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:04.755260 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-77c8478b-849d-4254-ac82-1a0a6192fdb4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1662 microversion: 2.1 time: 0.158777 Sep 01 16:38:04.755840 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 321/612] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:04 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1662 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:04.803757 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d61b8322-2901-46e8-99f7-bb5a63792ed0 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:04.804448 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d61b8322-2901-46e8-99f7-bb5a63792ed0 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:04.810597 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d61b8322-2901-46e8-99f7-bb5a63792ed0 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.811357 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d61b8322-2901-46e8-99f7-bb5a63792ed0 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.811784 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d61b8322-2901-46e8-99f7-bb5a63792ed0 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:04.812471 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d61b8322-2901-46e8-99f7-bb5a63792ed0 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.816878 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d61b8322-2901-46e8-99f7-bb5a63792ed0 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.817347 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d61b8322-2901-46e8-99f7-bb5a63792ed0 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:05.118610 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d61b8322-2901-46e8-99f7-bb5a63792ed0 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:05.127394 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d61b8322-2901-46e8-99f7-bb5a63792ed0 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 200 len: 1319 microversion: 2.1 time: 0.328212 Sep 01 16:38:05.127970 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 292/613] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:04 2022] GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:05.776737 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7ee489f8-96a0-4d97-990e-8eec44be1d03 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:05.778055 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7ee489f8-96a0-4d97-990e-8eec44be1d03 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:05.785926 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ee489f8-96a0-4d97-990e-8eec44be1d03 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:05.786433 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ee489f8-96a0-4d97-990e-8eec44be1d03 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:05.786854 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ee489f8-96a0-4d97-990e-8eec44be1d03 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:05.787854 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ee489f8-96a0-4d97-990e-8eec44be1d03 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:05.788453 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ee489f8-96a0-4d97-990e-8eec44be1d03 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:05.789030 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ee489f8-96a0-4d97-990e-8eec44be1d03 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:05.953088 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7ee489f8-96a0-4d97-990e-8eec44be1d03 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:05.960874 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7ee489f8-96a0-4d97-990e-8eec44be1d03 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1662 microversion: 2.1 time: 0.188729 Sep 01 16:38:05.962173 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 322/614] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:05 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1662 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:06.148544 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-4095e978-8bd3-49d6-9379-376cab9f7066 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:06.149553 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-4095e978-8bd3-49d6-9379-376cab9f7066 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:06.151994 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:06.158230 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4095e978-8bd3-49d6-9379-376cab9f7066 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:06.158721 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4095e978-8bd3-49d6-9379-376cab9f7066 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:06.159145 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4095e978-8bd3-49d6-9379-376cab9f7066 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:06.159821 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4095e978-8bd3-49d6-9379-376cab9f7066 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:06.160264 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4095e978-8bd3-49d6-9379-376cab9f7066 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:06.160677 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4095e978-8bd3-49d6-9379-376cab9f7066 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:06.287858 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-4095e978-8bd3-49d6-9379-376cab9f7066 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:06.295937 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-4095e978-8bd3-49d6-9379-376cab9f7066 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 200 len: 1319 microversion: 2.1 time: 0.151289 Sep 01 16:38:06.296498 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 293/615] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:06 2022] GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:06.982798 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ad5885f3-ad7e-4919-8075-397e6143449b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:06.983335 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ad5885f3-ad7e-4919-8075-397e6143449b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:06.989865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad5885f3-ad7e-4919-8075-397e6143449b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:06.990376 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad5885f3-ad7e-4919-8075-397e6143449b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:06.990810 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad5885f3-ad7e-4919-8075-397e6143449b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:06.991490 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad5885f3-ad7e-4919-8075-397e6143449b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:06.991938 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad5885f3-ad7e-4919-8075-397e6143449b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:06.992355 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad5885f3-ad7e-4919-8075-397e6143449b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:07.127222 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ad5885f3-ad7e-4919-8075-397e6143449b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:07.135937 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ad5885f3-ad7e-4919-8075-397e6143449b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1666 microversion: 2.1 time: 0.157038 Sep 01 16:38:07.136510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 323/616] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:06 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:07.316174 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ed82705d-182d-423b-bec3-7998126179db tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:07.316758 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ed82705d-182d-423b-bec3-7998126179db tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:07.323153 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed82705d-182d-423b-bec3-7998126179db tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:07.323623 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed82705d-182d-423b-bec3-7998126179db tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:07.324052 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed82705d-182d-423b-bec3-7998126179db tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:07.324724 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed82705d-182d-423b-bec3-7998126179db tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:07.325165 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed82705d-182d-423b-bec3-7998126179db tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:07.325577 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed82705d-182d-423b-bec3-7998126179db tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:07.456016 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ed82705d-182d-423b-bec3-7998126179db tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:07.464092 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ed82705d-182d-423b-bec3-7998126179db tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 200 len: 1319 microversion: 2.1 time: 0.151741 Sep 01 16:38:07.464648 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 294/617] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:07 2022] GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:07.675565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f7676c2c-891f-410e-b897-f305593f1223 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a874aaf9-7c64-4ad8-be12-ac8423450f9d"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:07.677925 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f7676c2c-891f-410e-b897-f305593f1223 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:07.684648 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7676c2c-891f-410e-b897-f305593f1223 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:07.685130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7676c2c-891f-410e-b897-f305593f1223 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:07.685556 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7676c2c-891f-410e-b897-f305593f1223 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:07.686258 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7676c2c-891f-410e-b897-f305593f1223 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:07.686720 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7676c2c-891f-410e-b897-f305593f1223 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:07.687146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7676c2c-891f-410e-b897-f305593f1223 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:07.690827 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:07.864157 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-d47560c3-bfeb-4b51-b8b1-71e1eac8cca7 req-05a1a917-b5fc-45a6-90e5-c2a28e08c19e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1e61cdb-828c-466f-b7ca-7bbd7df3ea43", "name": "network-vif-plugged", "status": "completed", "tag": "87981084-4264-485a-8bbe-2a3b814a0390"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:07.881655 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-d47560c3-bfeb-4b51-b8b1-71e1eac8cca7 req-05a1a917-b5fc-45a6-90e5-c2a28e08c19e service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:07.882137 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-d47560c3-bfeb-4b51-b8b1-71e1eac8cca7 req-05a1a917-b5fc-45a6-90e5-c2a28e08c19e service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:07.882806 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-d47560c3-bfeb-4b51-b8b1-71e1eac8cca7 req-05a1a917-b5fc-45a6-90e5-c2a28e08c19e service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:07.893963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-d47560c3-bfeb-4b51-b8b1-71e1eac8cca7 req-05a1a917-b5fc-45a6-90e5-c2a28e08c19e service nova] Creating event network-vif-plugged:87981084-4264-485a-8bbe-2a3b814a0390 for instance e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 on hv-cinder-85220 Sep 01 16:38:07.899104 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-d47560c3-bfeb-4b51-b8b1-71e1eac8cca7 req-05a1a917-b5fc-45a6-90e5-c2a28e08c19e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039408 Sep 01 16:38:07.900085 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 295/618] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:07.979509 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f7676c2c-891f-410e-b897-f305593f1223 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "POST /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308060 Sep 01 16:38:07.980125 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 324/619] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 1 16:38:07 2022] POST /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:08.484617 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e9ea3f0c-04ab-4d3b-a7ad-3278a883f882 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:08.485220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-e9ea3f0c-04ab-4d3b-a7ad-3278a883f882 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:08.491322 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e9ea3f0c-04ab-4d3b-a7ad-3278a883f882 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:08.491802 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e9ea3f0c-04ab-4d3b-a7ad-3278a883f882 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:08.492235 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e9ea3f0c-04ab-4d3b-a7ad-3278a883f882 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:08.492913 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e9ea3f0c-04ab-4d3b-a7ad-3278a883f882 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:08.493866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e9ea3f0c-04ab-4d3b-a7ad-3278a883f882 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:08.494311 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e9ea3f0c-04ab-4d3b-a7ad-3278a883f882 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:08.498262 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:08.628513 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e9ea3f0c-04ab-4d3b-a7ad-3278a883f882 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:08.636466 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-e9ea3f0c-04ab-4d3b-a7ad-3278a883f882 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 200 len: 1319 microversion: 2.1 time: 0.156158 Sep 01 16:38:08.637030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 296/620] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:08 2022] GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:09.658323 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9b48115c-2ae9-4a51-ba3b-9bf3c1f58e7a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:09.658923 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9b48115c-2ae9-4a51-ba3b-9bf3c1f58e7a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:09.661310 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:09.666906 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b48115c-2ae9-4a51-ba3b-9bf3c1f58e7a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.667376 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b48115c-2ae9-4a51-ba3b-9bf3c1f58e7a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.667800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b48115c-2ae9-4a51-ba3b-9bf3c1f58e7a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:09.668480 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b48115c-2ae9-4a51-ba3b-9bf3c1f58e7a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.668919 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b48115c-2ae9-4a51-ba3b-9bf3c1f58e7a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.669336 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b48115c-2ae9-4a51-ba3b-9bf3c1f58e7a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:09.795529 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9b48115c-2ae9-4a51-ba3b-9bf3c1f58e7a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:09.803327 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9b48115c-2ae9-4a51-ba3b-9bf3c1f58e7a tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 200 len: 1508 microversion: 2.1 time: 0.149351 Sep 01 16:38:09.803882 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 325/621] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:09 2022] GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:09.824224 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-57b6f745-b0ea-4dd5-9d82-f5c4b37ad750 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3fc1cc8-462c-4304-96c5-b5d5575f452c", "device": "/dev/sdb"}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:09.826584 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-57b6f745-b0ea-4dd5-9d82-f5c4b37ad750 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:09.828862 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:09.829500 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=6 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:09.835351 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-57b6f745-b0ea-4dd5-9d82-f5c4b37ad750 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.835821 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-57b6f745-b0ea-4dd5-9d82-f5c4b37ad750 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.836246 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-57b6f745-b0ea-4dd5-9d82-f5c4b37ad750 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:09.836923 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-57b6f745-b0ea-4dd5-9d82-f5c4b37ad750 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.837363 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-57b6f745-b0ea-4dd5-9d82-f5c4b37ad750 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.837777 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-57b6f745-b0ea-4dd5-9d82-f5c4b37ad750 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:10.335378 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-57b6f745-b0ea-4dd5-9d82-f5c4b37ad750 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "POST /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515412 Sep 01 16:38:10.335980 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 297/622] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 1 16:38:09 2022] POST /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43/os-volume_attachments => generated 194 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:15.498200 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bdac9505-aa0b-45b6-b831-8c7a3a7a9da5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:15.501096 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bdac9505-aa0b-45b6-b831-8c7a3a7a9da5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:15.507725 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bdac9505-aa0b-45b6-b831-8c7a3a7a9da5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:15.508243 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bdac9505-aa0b-45b6-b831-8c7a3a7a9da5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:15.508699 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bdac9505-aa0b-45b6-b831-8c7a3a7a9da5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:15.509543 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bdac9505-aa0b-45b6-b831-8c7a3a7a9da5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:15.509918 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bdac9505-aa0b-45b6-b831-8c7a3a7a9da5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:15.510420 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bdac9505-aa0b-45b6-b831-8c7a3a7a9da5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:15.532655 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-bdac9505-aa0b-45b6-b831-8c7a3a7a9da5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lazy-loading 'flavor' on Instance uuid 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:38:15.656059 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bdac9505-aa0b-45b6-b831-8c7a3a7a9da5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "POST /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/action" status: 200 len: 32 microversion: 2.1 time: 0.161657 Sep 01 16:38:15.656660 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 326/623] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 1 16:38:15 2022] POST /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:38:15.668079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e31fdc17-039c-4185-9aeb-79938a95f163 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:15.669249 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-e31fdc17-039c-4185-9aeb-79938a95f163 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:15.676084 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e31fdc17-039c-4185-9aeb-79938a95f163 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:15.676773 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e31fdc17-039c-4185-9aeb-79938a95f163 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:15.677197 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e31fdc17-039c-4185-9aeb-79938a95f163 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:15.677886 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e31fdc17-039c-4185-9aeb-79938a95f163 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:15.678361 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e31fdc17-039c-4185-9aeb-79938a95f163 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:15.678798 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e31fdc17-039c-4185-9aeb-79938a95f163 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:15.891148 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e31fdc17-039c-4185-9aeb-79938a95f163 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:15.900029 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-e31fdc17-039c-4185-9aeb-79938a95f163 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.237401 Sep 01 16:38:15.907218 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 298/624] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:15 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:16.923723 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-95d99696-c266-4004-a6a8-5048194fd011 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:16.924405 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-95d99696-c266-4004-a6a8-5048194fd011 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:16.930513 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95d99696-c266-4004-a6a8-5048194fd011 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:16.930928 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95d99696-c266-4004-a6a8-5048194fd011 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:16.931356 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95d99696-c266-4004-a6a8-5048194fd011 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:16.932024 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95d99696-c266-4004-a6a8-5048194fd011 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:16.932467 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95d99696-c266-4004-a6a8-5048194fd011 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:16.932877 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95d99696-c266-4004-a6a8-5048194fd011 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:17.064405 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-95d99696-c266-4004-a6a8-5048194fd011 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:17.072449 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-95d99696-c266-4004-a6a8-5048194fd011 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.153904 Sep 01 16:38:17.073003 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 327/625] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:16 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:18.093671 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d1508b0c-61b6-41bc-86cf-764e3dea8f6d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:18.094297 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d1508b0c-61b6-41bc-86cf-764e3dea8f6d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:18.101137 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d1508b0c-61b6-41bc-86cf-764e3dea8f6d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:18.101615 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d1508b0c-61b6-41bc-86cf-764e3dea8f6d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:18.102048 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d1508b0c-61b6-41bc-86cf-764e3dea8f6d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:18.102756 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d1508b0c-61b6-41bc-86cf-764e3dea8f6d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:18.103203 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d1508b0c-61b6-41bc-86cf-764e3dea8f6d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:18.103630 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d1508b0c-61b6-41bc-86cf-764e3dea8f6d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:18.233585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d1508b0c-61b6-41bc-86cf-764e3dea8f6d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:18.242296 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d1508b0c-61b6-41bc-86cf-764e3dea8f6d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.152493 Sep 01 16:38:18.242857 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 299/626] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:18 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:19.263400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-57a9af79-dd82-4869-b233-f19a71de9a00 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:19.264008 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-57a9af79-dd82-4869-b233-f19a71de9a00 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:19.267071 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=44 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:19.272368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-57a9af79-dd82-4869-b233-f19a71de9a00 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:19.272840 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-57a9af79-dd82-4869-b233-f19a71de9a00 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:19.273263 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-57a9af79-dd82-4869-b233-f19a71de9a00 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:19.273938 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-57a9af79-dd82-4869-b233-f19a71de9a00 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:19.274410 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-57a9af79-dd82-4869-b233-f19a71de9a00 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:19.275176 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-57a9af79-dd82-4869-b233-f19a71de9a00 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:19.411964 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-57a9af79-dd82-4869-b233-f19a71de9a00 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:19.420410 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-57a9af79-dd82-4869-b233-f19a71de9a00 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.160864 Sep 01 16:38:19.420968 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 328/627] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:19 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:20.441468 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-1c20a0e6-1d47-43ee-9710-97493e545ca0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:20.442033 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-1c20a0e6-1d47-43ee-9710-97493e545ca0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:20.448624 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1c20a0e6-1d47-43ee-9710-97493e545ca0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:20.449104 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1c20a0e6-1d47-43ee-9710-97493e545ca0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:20.449534 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1c20a0e6-1d47-43ee-9710-97493e545ca0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:20.450216 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1c20a0e6-1d47-43ee-9710-97493e545ca0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:20.450687 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1c20a0e6-1d47-43ee-9710-97493e545ca0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:20.451128 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1c20a0e6-1d47-43ee-9710-97493e545ca0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:20.579068 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-1c20a0e6-1d47-43ee-9710-97493e545ca0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:20.587186 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-1c20a0e6-1d47-43ee-9710-97493e545ca0 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.149747 Sep 01 16:38:20.587785 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 300/628] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:20 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:21.609276 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-48b4d7ad-a4f8-4e4b-ac48-42b07a62d9ee tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:21.609815 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-48b4d7ad-a4f8-4e4b-ac48-42b07a62d9ee tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:21.616345 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48b4d7ad-a4f8-4e4b-ac48-42b07a62d9ee tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:21.616816 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48b4d7ad-a4f8-4e4b-ac48-42b07a62d9ee tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:21.617245 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48b4d7ad-a4f8-4e4b-ac48-42b07a62d9ee tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:21.617922 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48b4d7ad-a4f8-4e4b-ac48-42b07a62d9ee tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:21.618400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48b4d7ad-a4f8-4e4b-ac48-42b07a62d9ee tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:21.618808 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48b4d7ad-a4f8-4e4b-ac48-42b07a62d9ee tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:21.753303 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-48b4d7ad-a4f8-4e4b-ac48-42b07a62d9ee tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:21.761553 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-48b4d7ad-a4f8-4e4b-ac48-42b07a62d9ee tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.156455 Sep 01 16:38:21.762126 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 329/629] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:21 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:22.784157 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f254abca-c4d8-4213-a3b7-03e16e66fa2c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:22.784785 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f254abca-c4d8-4213-a3b7-03e16e66fa2c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:22.791184 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f254abca-c4d8-4213-a3b7-03e16e66fa2c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.791664 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f254abca-c4d8-4213-a3b7-03e16e66fa2c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.792103 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f254abca-c4d8-4213-a3b7-03e16e66fa2c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:22.792791 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f254abca-c4d8-4213-a3b7-03e16e66fa2c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.793260 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f254abca-c4d8-4213-a3b7-03e16e66fa2c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.793676 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f254abca-c4d8-4213-a3b7-03e16e66fa2c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:22.920008 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f254abca-c4d8-4213-a3b7-03e16e66fa2c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:22.928189 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f254abca-c4d8-4213-a3b7-03e16e66fa2c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.148667 Sep 01 16:38:22.928743 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 301/630] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:22 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:23.949668 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-05c818e4-777a-475b-9a3c-3151f436d96f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:23.950318 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-05c818e4-777a-475b-9a3c-3151f436d96f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:23.957013 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05c818e4-777a-475b-9a3c-3151f436d96f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:23.957405 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05c818e4-777a-475b-9a3c-3151f436d96f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:23.957829 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05c818e4-777a-475b-9a3c-3151f436d96f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:23.958536 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05c818e4-777a-475b-9a3c-3151f436d96f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:23.958976 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05c818e4-777a-475b-9a3c-3151f436d96f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:23.959386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05c818e4-777a-475b-9a3c-3151f436d96f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:24.092582 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-05c818e4-777a-475b-9a3c-3151f436d96f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:24.101696 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-05c818e4-777a-475b-9a3c-3151f436d96f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.155844 Sep 01 16:38:24.102288 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 330/631] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:23 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:25.124161 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7e652bd7-f038-4f08-9296-a88f315a0f4f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:25.124826 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7e652bd7-f038-4f08-9296-a88f315a0f4f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:25.131856 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7e652bd7-f038-4f08-9296-a88f315a0f4f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:25.132336 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7e652bd7-f038-4f08-9296-a88f315a0f4f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:25.132766 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7e652bd7-f038-4f08-9296-a88f315a0f4f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:25.133447 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7e652bd7-f038-4f08-9296-a88f315a0f4f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:25.133892 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7e652bd7-f038-4f08-9296-a88f315a0f4f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:25.134340 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7e652bd7-f038-4f08-9296-a88f315a0f4f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:25.266489 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-7e652bd7-f038-4f08-9296-a88f315a0f4f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:25.274718 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7e652bd7-f038-4f08-9296-a88f315a0f4f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.154359 Sep 01 16:38:25.275285 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 302/632] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:25 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:26.297263 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9ec3ebd0-b095-4c69-a9a0-914ba6b7fc57 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:26.298434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9ec3ebd0-b095-4c69-a9a0-914ba6b7fc57 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:26.305003 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9ec3ebd0-b095-4c69-a9a0-914ba6b7fc57 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:26.305475 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9ec3ebd0-b095-4c69-a9a0-914ba6b7fc57 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:26.305898 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9ec3ebd0-b095-4c69-a9a0-914ba6b7fc57 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:26.306611 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9ec3ebd0-b095-4c69-a9a0-914ba6b7fc57 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:26.307058 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9ec3ebd0-b095-4c69-a9a0-914ba6b7fc57 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:26.307475 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9ec3ebd0-b095-4c69-a9a0-914ba6b7fc57 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:26.453143 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9ec3ebd0-b095-4c69-a9a0-914ba6b7fc57 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:26.463907 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9ec3ebd0-b095-4c69-a9a0-914ba6b7fc57 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.170557 Sep 01 16:38:26.464336 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 331/633] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:26 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:27.487143 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-4e2753cc-568f-4b57-bc0d-230bd725e698 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:27.488073 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-4e2753cc-568f-4b57-bc0d-230bd725e698 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:27.494288 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4e2753cc-568f-4b57-bc0d-230bd725e698 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.494773 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4e2753cc-568f-4b57-bc0d-230bd725e698 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.495194 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4e2753cc-568f-4b57-bc0d-230bd725e698 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.495889 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4e2753cc-568f-4b57-bc0d-230bd725e698 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.496324 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4e2753cc-568f-4b57-bc0d-230bd725e698 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.496758 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4e2753cc-568f-4b57-bc0d-230bd725e698 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.640688 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-4e2753cc-568f-4b57-bc0d-230bd725e698 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:27.648995 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-4e2753cc-568f-4b57-bc0d-230bd725e698 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.166754 Sep 01 16:38:27.649561 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 303/634] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:27 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:28.670510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0634f825-5dba-4dee-8f5c-40b3c0f02d29 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:28.671048 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0634f825-5dba-4dee-8f5c-40b3c0f02d29 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:28.678072 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0634f825-5dba-4dee-8f5c-40b3c0f02d29 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:28.678582 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0634f825-5dba-4dee-8f5c-40b3c0f02d29 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:28.679020 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0634f825-5dba-4dee-8f5c-40b3c0f02d29 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:28.679710 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0634f825-5dba-4dee-8f5c-40b3c0f02d29 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:28.680168 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0634f825-5dba-4dee-8f5c-40b3c0f02d29 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:28.680590 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0634f825-5dba-4dee-8f5c-40b3c0f02d29 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:28.812375 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0634f825-5dba-4dee-8f5c-40b3c0f02d29 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:28.821201 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0634f825-5dba-4dee-8f5c-40b3c0f02d29 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.154671 Sep 01 16:38:28.821762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 332/635] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:28 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:29.841920 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ad385e4e-f73a-45a4-b874-12e98071ff5e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:29.842572 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ad385e4e-f73a-45a4-b874-12e98071ff5e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:29.848873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad385e4e-f73a-45a4-b874-12e98071ff5e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:29.849340 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad385e4e-f73a-45a4-b874-12e98071ff5e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:29.850028 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad385e4e-f73a-45a4-b874-12e98071ff5e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:29.850736 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad385e4e-f73a-45a4-b874-12e98071ff5e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:29.851180 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad385e4e-f73a-45a4-b874-12e98071ff5e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:29.851594 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad385e4e-f73a-45a4-b874-12e98071ff5e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:29.986162 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ad385e4e-f73a-45a4-b874-12e98071ff5e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:29.994390 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ad385e4e-f73a-45a4-b874-12e98071ff5e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.156238 Sep 01 16:38:29.994953 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 304/636] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:29 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:31.016205 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-717cab36-0832-4e2a-8d53-9c78004d396e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:31.016749 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-717cab36-0832-4e2a-8d53-9c78004d396e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:31.023212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-717cab36-0832-4e2a-8d53-9c78004d396e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:31.023672 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-717cab36-0832-4e2a-8d53-9c78004d396e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:31.024101 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-717cab36-0832-4e2a-8d53-9c78004d396e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:31.024783 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-717cab36-0832-4e2a-8d53-9c78004d396e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:31.025232 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-717cab36-0832-4e2a-8d53-9c78004d396e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:31.025662 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-717cab36-0832-4e2a-8d53-9c78004d396e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:31.153079 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-717cab36-0832-4e2a-8d53-9c78004d396e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:31.161202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-717cab36-0832-4e2a-8d53-9c78004d396e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.149024 Sep 01 16:38:31.161770 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 333/637] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:31 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:32.187362 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-5c6bad5a-f50f-4a5a-9961-c5103de141fa tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:32.188438 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-5c6bad5a-f50f-4a5a-9961-c5103de141fa tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:32.199344 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5c6bad5a-f50f-4a5a-9961-c5103de141fa tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:32.200163 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5c6bad5a-f50f-4a5a-9961-c5103de141fa tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:32.200905 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5c6bad5a-f50f-4a5a-9961-c5103de141fa tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:32.202074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5c6bad5a-f50f-4a5a-9961-c5103de141fa tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:32.202858 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5c6bad5a-f50f-4a5a-9961-c5103de141fa tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:32.203584 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5c6bad5a-f50f-4a5a-9961-c5103de141fa tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:32.331709 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-5c6bad5a-f50f-4a5a-9961-c5103de141fa tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:32.340089 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-5c6bad5a-f50f-4a5a-9961-c5103de141fa tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.159878 Sep 01 16:38:32.340680 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 305/638] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:32 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:33.362590 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7120e706-66ef-42f5-90da-c9203f4e74e6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:33.363283 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7120e706-66ef-42f5-90da-c9203f4e74e6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:33.370440 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7120e706-66ef-42f5-90da-c9203f4e74e6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:33.370440 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7120e706-66ef-42f5-90da-c9203f4e74e6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:33.370993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7120e706-66ef-42f5-90da-c9203f4e74e6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:33.371568 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7120e706-66ef-42f5-90da-c9203f4e74e6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:33.372011 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7120e706-66ef-42f5-90da-c9203f4e74e6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:33.372431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7120e706-66ef-42f5-90da-c9203f4e74e6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:33.501978 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7120e706-66ef-42f5-90da-c9203f4e74e6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:33.510430 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7120e706-66ef-42f5-90da-c9203f4e74e6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.152396 Sep 01 16:38:33.511009 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 334/639] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:33 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:34.532001 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-174fd3a5-5824-4b14-8616-c84e052efe92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:34.532560 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-174fd3a5-5824-4b14-8616-c84e052efe92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:34.539124 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-174fd3a5-5824-4b14-8616-c84e052efe92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.539603 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-174fd3a5-5824-4b14-8616-c84e052efe92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.540354 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-174fd3a5-5824-4b14-8616-c84e052efe92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:34.540978 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-174fd3a5-5824-4b14-8616-c84e052efe92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.541163 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-174fd3a5-5824-4b14-8616-c84e052efe92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.541584 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-174fd3a5-5824-4b14-8616-c84e052efe92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:34.673709 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-174fd3a5-5824-4b14-8616-c84e052efe92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:34.681961 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-174fd3a5-5824-4b14-8616-c84e052efe92 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.154404 Sep 01 16:38:34.682620 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 306/640] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:34 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:34.858857 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-29c1017a-ba35-4aaf-bb52-3cda602f61a2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:34.859445 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-29c1017a-ba35-4aaf-bb52-3cda602f61a2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:34.865659 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29c1017a-ba35-4aaf-bb52-3cda602f61a2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.866129 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29c1017a-ba35-4aaf-bb52-3cda602f61a2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.866581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29c1017a-ba35-4aaf-bb52-3cda602f61a2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:34.867251 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29c1017a-ba35-4aaf-bb52-3cda602f61a2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.867692 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29c1017a-ba35-4aaf-bb52-3cda602f61a2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.868108 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29c1017a-ba35-4aaf-bb52-3cda602f61a2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:34.897169 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-29c1017a-ba35-4aaf-bb52-3cda602f61a2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/os-volume_attachments/3808a0ed-562c-4bcd-9629-aee1a32b8690" status: 200 len: 194 microversion: 2.20 time: 0.042320 Sep 01 16:38:34.897749 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 335/641] 10.222.0.18 () {60 vars in 1454 bytes} [Thu Sep 1 16:38:34 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/os-volume_attachments/3808a0ed-562c-4bcd-9629-aee1a32b8690 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:38:34.967397 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-37c5f1ab-0b37-48b5-af3b-04456030bad5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:34.967848 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-37c5f1ab-0b37-48b5-af3b-04456030bad5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:34.975188 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-37c5f1ab-0b37-48b5-af3b-04456030bad5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.975687 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-37c5f1ab-0b37-48b5-af3b-04456030bad5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.976122 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-37c5f1ab-0b37-48b5-af3b-04456030bad5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:34.976811 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-37c5f1ab-0b37-48b5-af3b-04456030bad5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.977261 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-37c5f1ab-0b37-48b5-af3b-04456030bad5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.977681 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-37c5f1ab-0b37-48b5-af3b-04456030bad5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:35.013638 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-aee3de58-7a64-4b54-9dab-3eac8f6de1a8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:35.014181 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-aee3de58-7a64-4b54-9dab-3eac8f6de1a8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:35.021002 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aee3de58-7a64-4b54-9dab-3eac8f6de1a8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:35.021628 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aee3de58-7a64-4b54-9dab-3eac8f6de1a8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:35.022101 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aee3de58-7a64-4b54-9dab-3eac8f6de1a8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:35.022859 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aee3de58-7a64-4b54-9dab-3eac8f6de1a8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:35.023417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aee3de58-7a64-4b54-9dab-3eac8f6de1a8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:35.023872 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aee3de58-7a64-4b54-9dab-3eac8f6de1a8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:35.062116 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.objects.instance [None req-37c5f1ab-0b37-48b5-af3b-04456030bad5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lazy-loading 'services' on Instance uuid 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f {{(pid=127178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:38:35.113108 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-aee3de58-7a64-4b54-9dab-3eac8f6de1a8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lazy-loading 'services' on Instance uuid e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:38:35.143169 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-37c5f1ab-0b37-48b5-af3b-04456030bad5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/os-volume_attachments/3808a0ed-562c-4bcd-9629-aee1a32b8690" status: 202 len: 0 microversion: 2.20 time: 0.180264 Sep 01 16:38:35.144285 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 307/642] 10.222.0.18 () {60 vars in 1457 bytes} [Thu Sep 1 16:38:34 2022] DELETE /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/os-volume_attachments/3808a0ed-562c-4bcd-9629-aee1a32b8690 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:38:35.155178 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-cce51dc2-bdea-41a5-ae5a-d62c5fcdf384 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:35.157733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-cce51dc2-bdea-41a5-ae5a-d62c5fcdf384 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:35.164408 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cce51dc2-bdea-41a5-ae5a-d62c5fcdf384 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:35.164893 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cce51dc2-bdea-41a5-ae5a-d62c5fcdf384 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:35.165329 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cce51dc2-bdea-41a5-ae5a-d62c5fcdf384 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:35.166163 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cce51dc2-bdea-41a5-ae5a-d62c5fcdf384 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:35.166730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cce51dc2-bdea-41a5-ae5a-d62c5fcdf384 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:35.167361 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cce51dc2-bdea-41a5-ae5a-d62c5fcdf384 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:35.189638 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:35.207245 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-aee3de58-7a64-4b54-9dab-3eac8f6de1a8 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43/os-volume_attachments/b3fc1cc8-462c-4304-96c5-b5d5575f452c" status: 202 len: 0 microversion: 2.1 time: 0.197266 Sep 01 16:38:35.208065 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 336/643] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 1 16:38:35 2022] DELETE /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43/os-volume_attachments/b3fc1cc8-462c-4304-96c5-b5d5575f452c => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:38:35.209307 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-cce51dc2-bdea-41a5-ae5a-d62c5fcdf384 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060190 Sep 01 16:38:35.209893 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 308/644] 10.222.0.18 () {60 vars in 1343 bytes} [Thu Sep 1 16:38:35 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:38:35.707118 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c6f697e8-f4d1-40c8-82f7-7f4bedf2b0b9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:35.708123 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c6f697e8-f4d1-40c8-82f7-7f4bedf2b0b9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:35.716224 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6f697e8-f4d1-40c8-82f7-7f4bedf2b0b9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:35.716898 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6f697e8-f4d1-40c8-82f7-7f4bedf2b0b9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:35.717449 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6f697e8-f4d1-40c8-82f7-7f4bedf2b0b9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:35.718400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6f697e8-f4d1-40c8-82f7-7f4bedf2b0b9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:35.719054 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6f697e8-f4d1-40c8-82f7-7f4bedf2b0b9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:35.719748 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6f697e8-f4d1-40c8-82f7-7f4bedf2b0b9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:35.855720 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c6f697e8-f4d1-40c8-82f7-7f4bedf2b0b9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:35.870071 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c6f697e8-f4d1-40c8-82f7-7f4bedf2b0b9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.170213 Sep 01 16:38:35.871106 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 337/645] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:35 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:36.222775 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c7fc59b3-013e-4efa-9e4c-35fed4b2d2ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:36.225202 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c7fc59b3-013e-4efa-9e4c-35fed4b2d2ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:36.227672 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=32 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:36.232894 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c7fc59b3-013e-4efa-9e4c-35fed4b2d2ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:36.233376 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c7fc59b3-013e-4efa-9e4c-35fed4b2d2ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:36.233827 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c7fc59b3-013e-4efa-9e4c-35fed4b2d2ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:36.234729 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c7fc59b3-013e-4efa-9e4c-35fed4b2d2ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:36.235026 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c7fc59b3-013e-4efa-9e4c-35fed4b2d2ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:36.235452 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c7fc59b3-013e-4efa-9e4c-35fed4b2d2ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:36.265309 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c7fc59b3-013e-4efa-9e4c-35fed4b2d2ab tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047207 Sep 01 16:38:36.266396 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 309/646] 10.222.0.18 () {60 vars in 1343 bytes} [Thu Sep 1 16:38:36 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:38:36.892922 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-33ade0d5-0220-43e0-ab46-85d25d0a10f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:36.893545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-33ade0d5-0220-43e0-ab46-85d25d0a10f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:36.900106 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-33ade0d5-0220-43e0-ab46-85d25d0a10f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:36.900586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-33ade0d5-0220-43e0-ab46-85d25d0a10f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:36.901022 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-33ade0d5-0220-43e0-ab46-85d25d0a10f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:36.901709 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-33ade0d5-0220-43e0-ab46-85d25d0a10f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:36.902160 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-33ade0d5-0220-43e0-ab46-85d25d0a10f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:36.902615 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-33ade0d5-0220-43e0-ab46-85d25d0a10f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.034625 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-33ade0d5-0220-43e0-ab46-85d25d0a10f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:37.043116 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-33ade0d5-0220-43e0-ab46-85d25d0a10f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.154010 Sep 01 16:38:37.043668 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 338/647] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:36 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:37.278713 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f15ba261-efc2-4055-befe-c3b66ccb2bf2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:37.280745 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f15ba261-efc2-4055-befe-c3b66ccb2bf2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:37.287642 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f15ba261-efc2-4055-befe-c3b66ccb2bf2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.288122 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f15ba261-efc2-4055-befe-c3b66ccb2bf2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.288555 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f15ba261-efc2-4055-befe-c3b66ccb2bf2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.289241 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f15ba261-efc2-4055-befe-c3b66ccb2bf2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.289685 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f15ba261-efc2-4055-befe-c3b66ccb2bf2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.290112 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f15ba261-efc2-4055-befe-c3b66ccb2bf2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.315405 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:37.320253 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f15ba261-efc2-4055-befe-c3b66ccb2bf2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045865 Sep 01 16:38:37.320833 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 310/648] 10.222.0.18 () {60 vars in 1343 bytes} [Thu Sep 1 16:38:37 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:37.386087 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-58b6297c-e68a-49f1-9a1e-d89aa090f51b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:37.386622 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-58b6297c-e68a-49f1-9a1e-d89aa090f51b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:37.392616 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-58b6297c-e68a-49f1-9a1e-d89aa090f51b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.393100 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-58b6297c-e68a-49f1-9a1e-d89aa090f51b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.393534 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-58b6297c-e68a-49f1-9a1e-d89aa090f51b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.394220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-58b6297c-e68a-49f1-9a1e-d89aa090f51b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.394702 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-58b6297c-e68a-49f1-9a1e-d89aa090f51b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.395126 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-58b6297c-e68a-49f1-9a1e-d89aa090f51b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.406936 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6dccd74d-faa7-4b06-8405-7b27c53a211b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:37.407430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-6dccd74d-faa7-4b06-8405-7b27c53a211b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:37.414510 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6dccd74d-faa7-4b06-8405-7b27c53a211b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.414994 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6dccd74d-faa7-4b06-8405-7b27c53a211b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.415430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6dccd74d-faa7-4b06-8405-7b27c53a211b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.416118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6dccd74d-faa7-4b06-8405-7b27c53a211b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.416607 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6dccd74d-faa7-4b06-8405-7b27c53a211b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.417001 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6dccd74d-faa7-4b06-8405-7b27c53a211b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.421125 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-58b6297c-e68a-49f1-9a1e-d89aa090f51b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:38:37.446358 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-6dccd74d-faa7-4b06-8405-7b27c53a211b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Going to try to terminate instance {{(pid=127178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:38:37.507297 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-58b6297c-e68a-49f1-9a1e-d89aa090f51b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 204 len: 0 microversion: 2.20 time: 0.124657 Sep 01 16:38:37.507920 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 339/649] 10.222.0.18 () {60 vars in 1280 bytes} [Thu Sep 1 16:38:37 2022] DELETE /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 16:38:37.517181 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a07000f8-ac11-4a73-8018-9cd8d54c3eac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:37.517871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a07000f8-ac11-4a73-8018-9cd8d54c3eac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:37.525547 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a07000f8-ac11-4a73-8018-9cd8d54c3eac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.526028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a07000f8-ac11-4a73-8018-9cd8d54c3eac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.526620 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a07000f8-ac11-4a73-8018-9cd8d54c3eac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.527185 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a07000f8-ac11-4a73-8018-9cd8d54c3eac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.527634 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a07000f8-ac11-4a73-8018-9cd8d54c3eac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.528045 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a07000f8-ac11-4a73-8018-9cd8d54c3eac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.539582 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-6dccd74d-faa7-4b06-8405-7b27c53a211b tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 204 len: 0 microversion: 2.1 time: 0.136632 Sep 01 16:38:37.540175 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 311/650] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:38:37 2022] DELETE /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 16:38:37.549114 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6914b72d-aca9-4d1e-bd11-10df56747f97 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:37.549826 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-6914b72d-aca9-4d1e-bd11-10df56747f97 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:37.555962 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6914b72d-aca9-4d1e-bd11-10df56747f97 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.556433 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6914b72d-aca9-4d1e-bd11-10df56747f97 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.556857 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6914b72d-aca9-4d1e-bd11-10df56747f97 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.557544 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6914b72d-aca9-4d1e-bd11-10df56747f97 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.557982 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6914b72d-aca9-4d1e-bd11-10df56747f97 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.558433 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6914b72d-aca9-4d1e-bd11-10df56747f97 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.671251 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a07000f8-ac11-4a73-8018-9cd8d54c3eac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:37.679845 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a07000f8-ac11-4a73-8018-9cd8d54c3eac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:37.681299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a07000f8-ac11-4a73-8018-9cd8d54c3eac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:37.682478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a07000f8-ac11-4a73-8018-9cd8d54c3eac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.169780 Sep 01 16:38:37.683039 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 340/651] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:37 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:37.698146 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-6914b72d-aca9-4d1e-bd11-10df56747f97 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:37.706975 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-6914b72d-aca9-4d1e-bd11-10df56747f97 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 200 len: 1560 microversion: 2.1 time: 0.162423 Sep 01 16:38:37.707539 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 312/652] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:37 2022] GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:38.066353 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ccac2cfd-ae8c-444b-9642-952b9fe17233 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:38.067199 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ccac2cfd-ae8c-444b-9642-952b9fe17233 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:38.073598 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ccac2cfd-ae8c-444b-9642-952b9fe17233 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.074102 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ccac2cfd-ae8c-444b-9642-952b9fe17233 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.074570 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ccac2cfd-ae8c-444b-9642-952b9fe17233 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.075266 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ccac2cfd-ae8c-444b-9642-952b9fe17233 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.075746 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ccac2cfd-ae8c-444b-9642-952b9fe17233 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.076168 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ccac2cfd-ae8c-444b-9642-952b9fe17233 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.206125 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ccac2cfd-ae8c-444b-9642-952b9fe17233 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:38.214420 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ccac2cfd-ae8c-444b-9642-952b9fe17233 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.153178 Sep 01 16:38:38.214991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 341/653] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:38 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:38.705894 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b82cbedc-6588-4a34-baa0-ba4cc8b8056e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:38.706534 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b82cbedc-6588-4a34-baa0-ba4cc8b8056e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:38.712974 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82cbedc-6588-4a34-baa0-ba4cc8b8056e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.713454 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82cbedc-6588-4a34-baa0-ba4cc8b8056e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.713888 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82cbedc-6588-4a34-baa0-ba4cc8b8056e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.714619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82cbedc-6588-4a34-baa0-ba4cc8b8056e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.715094 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82cbedc-6588-4a34-baa0-ba4cc8b8056e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.715516 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82cbedc-6588-4a34-baa0-ba4cc8b8056e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.731672 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-03b6bed5-de9c-457d-83d9-ea7ab1dd12c4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:38.732688 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-03b6bed5-de9c-457d-83d9-ea7ab1dd12c4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:38.742383 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03b6bed5-de9c-457d-83d9-ea7ab1dd12c4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.743210 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03b6bed5-de9c-457d-83d9-ea7ab1dd12c4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.743996 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03b6bed5-de9c-457d-83d9-ea7ab1dd12c4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.745151 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03b6bed5-de9c-457d-83d9-ea7ab1dd12c4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.745918 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03b6bed5-de9c-457d-83d9-ea7ab1dd12c4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.746656 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03b6bed5-de9c-457d-83d9-ea7ab1dd12c4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.865592 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b82cbedc-6588-4a34-baa0-ba4cc8b8056e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:38.875141 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b82cbedc-6588-4a34-baa0-ba4cc8b8056e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:38.876922 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b82cbedc-6588-4a34-baa0-ba4cc8b8056e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:38.878303 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b82cbedc-6588-4a34-baa0-ba4cc8b8056e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.176322 Sep 01 16:38:38.878958 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 313/654] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:38 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:38.894299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-03b6bed5-de9c-457d-83d9-ea7ab1dd12c4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:38.902022 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-03b6bed5-de9c-457d-83d9-ea7ab1dd12c4 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 200 len: 1514 microversion: 2.1 time: 0.177258 Sep 01 16:38:38.902606 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 342/655] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:38 2022] GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:39.236051 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-074d6fb2-16c9-4a3b-8b41-853e033dbcb5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:39.236646 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-074d6fb2-16c9-4a3b-8b41-853e033dbcb5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:39.242946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-074d6fb2-16c9-4a3b-8b41-853e033dbcb5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.243418 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-074d6fb2-16c9-4a3b-8b41-853e033dbcb5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.243843 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-074d6fb2-16c9-4a3b-8b41-853e033dbcb5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.244521 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-074d6fb2-16c9-4a3b-8b41-853e033dbcb5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.244958 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-074d6fb2-16c9-4a3b-8b41-853e033dbcb5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.245372 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-074d6fb2-16c9-4a3b-8b41-853e033dbcb5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.385144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-074d6fb2-16c9-4a3b-8b41-853e033dbcb5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:39.394212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-074d6fb2-16c9-4a3b-8b41-853e033dbcb5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.162086 Sep 01 16:38:39.398044 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 314/656] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:39 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:39.901913 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1dbe860b-94f4-4551-850b-1164161f1ff7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:39.902537 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1dbe860b-94f4-4551-850b-1164161f1ff7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:39.908937 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1dbe860b-94f4-4551-850b-1164161f1ff7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.909411 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1dbe860b-94f4-4551-850b-1164161f1ff7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.909833 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1dbe860b-94f4-4551-850b-1164161f1ff7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.910542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1dbe860b-94f4-4551-850b-1164161f1ff7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.911005 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1dbe860b-94f4-4551-850b-1164161f1ff7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.911414 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1dbe860b-94f4-4551-850b-1164161f1ff7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.923780 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-0debe324-bfb9-4970-a4d5-abd84506bc8c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:39.924430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0debe324-bfb9-4970-a4d5-abd84506bc8c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:39.931821 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0debe324-bfb9-4970-a4d5-abd84506bc8c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.932429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0debe324-bfb9-4970-a4d5-abd84506bc8c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.932964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0debe324-bfb9-4970-a4d5-abd84506bc8c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.933757 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0debe324-bfb9-4970-a4d5-abd84506bc8c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.934343 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0debe324-bfb9-4970-a4d5-abd84506bc8c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.934861 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0debe324-bfb9-4970-a4d5-abd84506bc8c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:40.054872 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1dbe860b-94f4-4551-850b-1164161f1ff7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:40.064384 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1dbe860b-94f4-4551-850b-1164161f1ff7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:40.065849 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1dbe860b-94f4-4551-850b-1164161f1ff7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:40.067056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1dbe860b-94f4-4551-850b-1164161f1ff7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.169221 Sep 01 16:38:40.067626 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 343/657] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:39 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:40.081720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0debe324-bfb9-4970-a4d5-abd84506bc8c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:40.089368 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-0debe324-bfb9-4970-a4d5-abd84506bc8c tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 200 len: 1514 microversion: 2.1 time: 0.170049 Sep 01 16:38:40.089939 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 315/658] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:39 2022] GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:40.415931 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1f50e8b0-2c3a-4ea9-966b-6c834a9af1e2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:40.416534 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1f50e8b0-2c3a-4ea9-966b-6c834a9af1e2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:40.423116 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1f50e8b0-2c3a-4ea9-966b-6c834a9af1e2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:40.423591 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1f50e8b0-2c3a-4ea9-966b-6c834a9af1e2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:40.424014 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1f50e8b0-2c3a-4ea9-966b-6c834a9af1e2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:40.424702 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1f50e8b0-2c3a-4ea9-966b-6c834a9af1e2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:40.425148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1f50e8b0-2c3a-4ea9-966b-6c834a9af1e2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:40.425569 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1f50e8b0-2c3a-4ea9-966b-6c834a9af1e2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:40.556488 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1f50e8b0-2c3a-4ea9-966b-6c834a9af1e2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:40.564704 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1f50e8b0-2c3a-4ea9-966b-6c834a9af1e2 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.152623 Sep 01 16:38:40.565270 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 344/659] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:40 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:41.090063 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-dc202808-fec0-4d80-ad0b-b902d03865a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:41.090754 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-dc202808-fec0-4d80-ad0b-b902d03865a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:41.097137 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dc202808-fec0-4d80-ad0b-b902d03865a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:41.097619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dc202808-fec0-4d80-ad0b-b902d03865a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:41.098050 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dc202808-fec0-4d80-ad0b-b902d03865a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:41.098757 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dc202808-fec0-4d80-ad0b-b902d03865a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:41.099201 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dc202808-fec0-4d80-ad0b-b902d03865a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:41.099878 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dc202808-fec0-4d80-ad0b-b902d03865a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:41.113745 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8bcafae2-aff4-46fe-b81e-db578aed8e09 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:41.114816 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8bcafae2-aff4-46fe-b81e-db578aed8e09 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:41.125553 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8bcafae2-aff4-46fe-b81e-db578aed8e09 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:41.126387 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8bcafae2-aff4-46fe-b81e-db578aed8e09 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:41.127096 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8bcafae2-aff4-46fe-b81e-db578aed8e09 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:41.128288 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8bcafae2-aff4-46fe-b81e-db578aed8e09 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:41.128883 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8bcafae2-aff4-46fe-b81e-db578aed8e09 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:41.129425 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8bcafae2-aff4-46fe-b81e-db578aed8e09 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:41.255703 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-dc202808-fec0-4d80-ad0b-b902d03865a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:41.264117 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-dc202808-fec0-4d80-ad0b-b902d03865a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:41.266266 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-dc202808-fec0-4d80-ad0b-b902d03865a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:41.267453 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-dc202808-fec0-4d80-ad0b-b902d03865a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.181260 Sep 01 16:38:41.267980 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 316/660] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:41 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:41.272946 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8bcafae2-aff4-46fe-b81e-db578aed8e09 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:41.281157 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8bcafae2-aff4-46fe-b81e-db578aed8e09 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 200 len: 1514 microversion: 2.1 time: 0.174130 Sep 01 16:38:41.282012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 345/661] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:41 2022] GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:41.587246 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-169d66a4-a555-4e43-8fb6-01c5cb9ed73c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:41.588075 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-169d66a4-a555-4e43-8fb6-01c5cb9ed73c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:41.597215 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-169d66a4-a555-4e43-8fb6-01c5cb9ed73c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:41.597215 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-169d66a4-a555-4e43-8fb6-01c5cb9ed73c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:41.597215 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-169d66a4-a555-4e43-8fb6-01c5cb9ed73c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:41.597215 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-169d66a4-a555-4e43-8fb6-01c5cb9ed73c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:41.597939 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-169d66a4-a555-4e43-8fb6-01c5cb9ed73c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:41.597939 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-169d66a4-a555-4e43-8fb6-01c5cb9ed73c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:41.864351 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-169d66a4-a555-4e43-8fb6-01c5cb9ed73c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:41.873052 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-169d66a4-a555-4e43-8fb6-01c5cb9ed73c tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.291152 Sep 01 16:38:41.873718 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 317/662] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:41 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:42.294358 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-80c865d4-0cb7-4090-ae8c-710e8980e009 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:42.295023 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-80c865d4-0cb7-4090-ae8c-710e8980e009 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:42.302366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-80c865d4-0cb7-4090-ae8c-710e8980e009 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:42.302844 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-80c865d4-0cb7-4090-ae8c-710e8980e009 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:42.303266 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-80c865d4-0cb7-4090-ae8c-710e8980e009 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:42.303952 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-80c865d4-0cb7-4090-ae8c-710e8980e009 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:42.304395 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-80c865d4-0cb7-4090-ae8c-710e8980e009 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:42.304806 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-80c865d4-0cb7-4090-ae8c-710e8980e009 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:42.305145 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-04d80842-39a8-4c67-b5f5-90dd4667f92d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:42.306158 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-04d80842-39a8-4c67-b5f5-90dd4667f92d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:42.315749 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04d80842-39a8-4c67-b5f5-90dd4667f92d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:42.316494 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04d80842-39a8-4c67-b5f5-90dd4667f92d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:42.317099 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04d80842-39a8-4c67-b5f5-90dd4667f92d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:42.318042 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04d80842-39a8-4c67-b5f5-90dd4667f92d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:42.318695 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04d80842-39a8-4c67-b5f5-90dd4667f92d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:42.319283 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04d80842-39a8-4c67-b5f5-90dd4667f92d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:42.460047 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-80c865d4-0cb7-4090-ae8c-710e8980e009 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:42.469875 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-80c865d4-0cb7-4090-ae8c-710e8980e009 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:42.471455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-80c865d4-0cb7-4090-ae8c-710e8980e009 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:42.472669 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-80c865d4-0cb7-4090-ae8c-710e8980e009 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1722 microversion: 2.20 time: 0.182332 Sep 01 16:38:42.473306 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 346/663] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:42 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:42.689317 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-04d80842-39a8-4c67-b5f5-90dd4667f92d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:42.697692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-04d80842-39a8-4c67-b5f5-90dd4667f92d tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 200 len: 1514 microversion: 2.1 time: 0.398517 Sep 01 16:38:42.698737 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 318/664] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:42 2022] GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 1514 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:42.893668 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a87f5426-57ae-4445-9d09-3d39f9948c56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:42.894429 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a87f5426-57ae-4445-9d09-3d39f9948c56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:42.901890 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a87f5426-57ae-4445-9d09-3d39f9948c56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:42.902902 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a87f5426-57ae-4445-9d09-3d39f9948c56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:42.904194 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a87f5426-57ae-4445-9d09-3d39f9948c56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:42.904919 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a87f5426-57ae-4445-9d09-3d39f9948c56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:42.906759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a87f5426-57ae-4445-9d09-3d39f9948c56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:42.907311 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a87f5426-57ae-4445-9d09-3d39f9948c56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:43.085075 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a87f5426-57ae-4445-9d09-3d39f9948c56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:43.094876 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a87f5426-57ae-4445-9d09-3d39f9948c56 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1733 microversion: 2.1 time: 0.205534 Sep 01 16:38:43.095465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 347/665] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:42 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1733 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:43.107424 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-beb3a0dd-348c-4b99-ae17-76024673e359 req-6192f057-314e-4e6b-a57c-b87fe22fc1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1e61cdb-828c-466f-b7ca-7bbd7df3ea43", "name": "network-vif-deleted", "tag": "87981084-4264-485a-8bbe-2a3b814a0390"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:43.121586 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-beb3a0dd-348c-4b99-ae17-76024673e359 req-6192f057-314e-4e6b-a57c-b87fe22fc1b6 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:43.122203 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-beb3a0dd-348c-4b99-ae17-76024673e359 req-6192f057-314e-4e6b-a57c-b87fe22fc1b6 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:43.122765 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-beb3a0dd-348c-4b99-ae17-76024673e359 req-6192f057-314e-4e6b-a57c-b87fe22fc1b6 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:43.134181 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-beb3a0dd-348c-4b99-ae17-76024673e359 req-6192f057-314e-4e6b-a57c-b87fe22fc1b6 service nova] Creating event network-vif-deleted:87981084-4264-485a-8bbe-2a3b814a0390 for instance e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 on hv-cinder-85220 Sep 01 16:38:43.140686 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-beb3a0dd-348c-4b99-ae17-76024673e359 req-6192f057-314e-4e6b-a57c-b87fe22fc1b6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036384 Sep 01 16:38:43.141626 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 319/666] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:43.496395 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-77976efc-84b3-4d5e-8eac-06f02678e95f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:43.497206 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-77976efc-84b3-4d5e-8eac-06f02678e95f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:43.513237 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-77976efc-84b3-4d5e-8eac-06f02678e95f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:43.514155 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-77976efc-84b3-4d5e-8eac-06f02678e95f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:43.514837 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-77976efc-84b3-4d5e-8eac-06f02678e95f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:43.516445 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-77976efc-84b3-4d5e-8eac-06f02678e95f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:43.517301 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-77976efc-84b3-4d5e-8eac-06f02678e95f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:43.517965 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-77976efc-84b3-4d5e-8eac-06f02678e95f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:43.599237 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-77976efc-84b3-4d5e-8eac-06f02678e95f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:43.610342 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-77976efc-84b3-4d5e-8eac-06f02678e95f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:43.611773 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-77976efc-84b3-4d5e-8eac-06f02678e95f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:43.612941 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-77976efc-84b3-4d5e-8eac-06f02678e95f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1367 microversion: 2.20 time: 0.120555 Sep 01 16:38:43.613507 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 348/667] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:43 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1367 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:43.725229 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-462f5d2b-de54-44d8-9291-73d3f45b417e tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:43.725907 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-462f5d2b-de54-44d8-9291-73d3f45b417e tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:43.734796 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-462f5d2b-de54-44d8-9291-73d3f45b417e tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:43.735778 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-462f5d2b-de54-44d8-9291-73d3f45b417e tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:43.736932 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-462f5d2b-de54-44d8-9291-73d3f45b417e tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:43.738176 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-462f5d2b-de54-44d8-9291-73d3f45b417e tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:43.738861 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-462f5d2b-de54-44d8-9291-73d3f45b417e tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:43.739642 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-462f5d2b-de54-44d8-9291-73d3f45b417e tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:43.784060 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-462f5d2b-de54-44d8-9291-73d3f45b417e tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:43.784768 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-462f5d2b-de54-44d8-9291-73d3f45b417e tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:43.785400 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-462f5d2b-de54-44d8-9291-73d3f45b417e tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:43.785994 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.objects.instance [None req-462f5d2b-de54-44d8-9291-73d3f45b417e tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lazy-loading 'fault' on Instance uuid e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 {{(pid=127178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:38:43.832898 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-462f5d2b-de54-44d8-9291-73d3f45b417e tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d4d3b4817e499196e01d1df96b4775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b1f2c2ff4e4338acd2a3367a4fdee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:43.842358 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-462f5d2b-de54-44d8-9291-73d3f45b417e tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 200 len: 1309 microversion: 2.1 time: 0.121828 Sep 01 16:38:43.842934 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 320/668] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:43 2022] GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 1309 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:44.126482 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0e33797d-e532-4a90-8d30-6353d57c9393 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:44.127096 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0e33797d-e532-4a90-8d30-6353d57c9393 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:44.133095 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0e33797d-e532-4a90-8d30-6353d57c9393 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.133588 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0e33797d-e532-4a90-8d30-6353d57c9393 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.134014 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0e33797d-e532-4a90-8d30-6353d57c9393 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.134741 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0e33797d-e532-4a90-8d30-6353d57c9393 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.135193 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0e33797d-e532-4a90-8d30-6353d57c9393 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.135611 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0e33797d-e532-4a90-8d30-6353d57c9393 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.294291 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0e33797d-e532-4a90-8d30-6353d57c9393 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:44.303994 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0e33797d-e532-4a90-8d30-6353d57c9393 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1713 microversion: 2.1 time: 0.182359 Sep 01 16:38:44.304584 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 349/669] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:44 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1713 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:44.440126 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-bcd820a5-1d76-4e35-8e15-39f59286b6c6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:44.440783 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-bcd820a5-1d76-4e35-8e15-39f59286b6c6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:44.447881 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bcd820a5-1d76-4e35-8e15-39f59286b6c6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.448668 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bcd820a5-1d76-4e35-8e15-39f59286b6c6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.449366 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bcd820a5-1d76-4e35-8e15-39f59286b6c6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.450531 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bcd820a5-1d76-4e35-8e15-39f59286b6c6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.451299 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bcd820a5-1d76-4e35-8e15-39f59286b6c6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.452008 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bcd820a5-1d76-4e35-8e15-39f59286b6c6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.639747 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-bcd820a5-1d76-4e35-8e15-39f59286b6c6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] HTTP exception thrown: Cannot 'detach_volume' instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e while it is in vm_state rescued Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-bcd820a5-1d76-4e35-8e15-39f59286b6c6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Request method failure captured: Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: DELETE /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-volume_attachments/a874aaf9-7c64-4ad8-be12-ac8423450f9d HTTP/1.1 Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN8F17LXR9QZKG1_VIEG9-p8CRv4W7TM6E6dScWkaJQxBYZmnEi3ulzPAVr0-b20dizp00dSNiiSfWFSUTO8kWHVwi7TysP99jGN0Cq7VR3f5DEHM8MBqhsccbwVjs5uyEAzYbVKihge-cMSlpBXs8gzVRuYafB1F18mDaUBDx4zRr4 Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: b4bbb5d3895c49fa8695d3bca946dbea Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1309500920 Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:38:44.642619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:38:44.644717 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:38:44.644717 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1309500920 Sep 01 16:38:44.644717 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: b4bbb5d3895c49fa8695d3bca946dbea Sep 01 16:38:44.644717 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1309500920 Sep 01 16:38:44.644717 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-ServerRescueNegativeTestJSON-1309500920-project Sep 01 16:38:44.644717 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:38:44.644717 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:38:44.644717 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: 8020db56bca04d61b5a6e40384c25715 Sep 01 16:38:44.644717 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1309500920-project Sep 01 16:38:44.644717 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:38:44.644717 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Cannot 'detach_volume' instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e while it is in vm_state rescued Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'server_id': '21f1e8ce-fea9-426e-8ce0-23b9f7851b4e', 'id': 'a874aaf9-7c64-4ad8-be12-ac8423450f9d'} Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:38:44.646537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:38:44.649333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 16:38:44.649333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 16:38:44.649333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 16:38:44.649333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 16:38:44.649333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e while it is in vm_state rescued Sep 01 16:38:44.649333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:38:44.649333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:44.649333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:38:44.649333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:44.649333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:44.649333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:44.649333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:38:44.649333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:38:44.649333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e while it is in vm_state rescued Sep 01 16:38:44.649333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:38:44.649333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-bcd820a5-1d76-4e35-8e15-39f59286b6c6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Returning 409 to user: Cannot 'detach_volume' instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e while it is in vm_state rescued {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:38:44.652535 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-bcd820a5-1d76-4e35-8e15-39f59286b6c6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "DELETE /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-volume_attachments/a874aaf9-7c64-4ad8-be12-ac8423450f9d" status: 409 len: 152 microversion: 2.1 time: 0.208498 Sep 01 16:38:44.652535 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 321/670] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 1 16:38:44 2022] DELETE /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-volume_attachments/a874aaf9-7c64-4ad8-be12-ac8423450f9d => generated 152 bytes in 211 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 01 16:38:44.653877 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7b32ca12-9c11-4944-a456-2211c348049e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:44.654617 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7b32ca12-9c11-4944-a456-2211c348049e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:44.662837 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-022c4a48-3eef-4724-8483-4474868f9090 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:44.663626 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7b32ca12-9c11-4944-a456-2211c348049e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.664063 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7b32ca12-9c11-4944-a456-2211c348049e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.664499 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7b32ca12-9c11-4944-a456-2211c348049e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.665501 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7b32ca12-9c11-4944-a456-2211c348049e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.665979 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7b32ca12-9c11-4944-a456-2211c348049e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.666438 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7b32ca12-9c11-4944-a456-2211c348049e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.666816 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-022c4a48-3eef-4724-8483-4474868f9090 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:44.682342 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-022c4a48-3eef-4724-8483-4474868f9090 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.683418 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-022c4a48-3eef-4724-8483-4474868f9090 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.684533 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-022c4a48-3eef-4724-8483-4474868f9090 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.692779 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-022c4a48-3eef-4724-8483-4474868f9090 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.693980 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-022c4a48-3eef-4724-8483-4474868f9090 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.695513 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-022c4a48-3eef-4724-8483-4474868f9090 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.778191 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-022c4a48-3eef-4724-8483-4474868f9090 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.778825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7b32ca12-9c11-4944-a456-2211c348049e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "POST /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/action" status: 202 len: 0 microversion: 2.1 time: 0.128947 Sep 01 16:38:44.779312 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-022c4a48-3eef-4724-8483-4474868f9090 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.779561 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-022c4a48-3eef-4724-8483-4474868f9090 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.780470 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-022c4a48-3eef-4724-8483-4474868f9090 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lazy-loading 'fault' on Instance uuid 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:38:44.783378 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 322/671] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 1 16:38:44 2022] POST /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:38:44.792257 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-10dd95c3-0846-4d97-a797-c304268b78f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:44.797966 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-10dd95c3-0846-4d97-a797-c304268b78f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:44.811730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10dd95c3-0846-4d97-a797-c304268b78f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.812833 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10dd95c3-0846-4d97-a797-c304268b78f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.813285 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10dd95c3-0846-4d97-a797-c304268b78f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.813984 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10dd95c3-0846-4d97-a797-c304268b78f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.814473 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10dd95c3-0846-4d97-a797-c304268b78f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.815097 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10dd95c3-0846-4d97-a797-c304268b78f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.853793 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-022c4a48-3eef-4724-8483-4474868f9090 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:44.861430 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-022c4a48-3eef-4724-8483-4474868f9090 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:44.863042 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-022c4a48-3eef-4724-8483-4474868f9090 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:44.864194 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-022c4a48-3eef-4724-8483-4474868f9090 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 200 len: 1372 microversion: 2.20 time: 0.209580 Sep 01 16:38:44.870933 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 350/672] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:44 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 1372 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:44.883771 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e3523a01-b903-4b5a-a26e-3e3b301aa883 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:44.884338 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e3523a01-b903-4b5a-a26e-3e3b301aa883 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] [instance: e1e61cdb-828c-466f-b7ca-7bbd7df3ea43] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:44.890970 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3523a01-b903-4b5a-a26e-3e3b301aa883 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.891838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3523a01-b903-4b5a-a26e-3e3b301aa883 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.892745 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3523a01-b903-4b5a-a26e-3e3b301aa883 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.893620 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3523a01-b903-4b5a-a26e-3e3b301aa883 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.894067 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3523a01-b903-4b5a-a26e-3e3b301aa883 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.894651 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3523a01-b903-4b5a-a26e-3e3b301aa883 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.912490 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-e3523a01-b903-4b5a-a26e-3e3b301aa883 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] HTTP exception thrown: Instance e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 could not be found. Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e3523a01-b903-4b5a-a26e-3e3b301aa883 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Request method failure captured: Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 HTTP/1.1 Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN914kSPfu6jrQMCy5l54o1wMkSQWB7fYGgK_n7G8ZFI0L_mFmg_KFP5A9yyubVELpKasNPOCjH-Z6wydzob6AwJnkYwuV94LVYHKZQs1ZgpwmKlYTK0jgvLoOX_WAvTIfa2irhJ2ycyKyy_R9D4K7lmRIUzrB1SpHEJcuXJ1S1zbro Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 09b1f2c2ff4e4338acd2a3367a4fdee5 Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesSnapshotTestJSON-193016146 Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:38:44.914146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:38:44.916605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/09b1f2c2ff4e4338acd2a3367a4fdee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_09b1f2c2ff4e4338acd2a3367a4fdee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/09b1f2c2ff4e4338acd2a3367a4fdee5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/09b1f2c2ff4e4338acd2a3367a4fdee5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:38:44.916605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesSnapshotTestJSON-193016146 Sep 01 16:38:44.916605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 09b1f2c2ff4e4338acd2a3367a4fdee5 Sep 01 16:38:44.916605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-193016146 Sep 01 16:38:44.916605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesSnapshotTestJSON-193016146-project Sep 01 16:38:44.916605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:38:44.916605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:38:44.916605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: b4d4d3b4817e499196e01d1df96b4775 Sep 01 16:38:44.916605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesSnapshotTestJSON-193016146-project Sep 01 16:38:44.916605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:38:44.916605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 could not be found. Sep 01 16:38:44.916605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': 'e1e61cdb-828c-466f-b7ca-7bbd7df3ea43'} Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 could not be found. Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:38:44.917984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 could not be found. Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 could not be found. Sep 01 16:38:44.922400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:38:44.924451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e3523a01-b903-4b5a-a26e-3e3b301aa883 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] Returning 404 to user: Instance e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:38:44.924451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e3523a01-b903-4b5a-a26e-3e3b301aa883 tempest-VolumesSnapshotTestJSON-193016146 tempest-VolumesSnapshotTestJSON-193016146-project] 10.222.0.18 "GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43" status: 404 len: 111 microversion: 2.1 time: 0.043575 Sep 01 16:38:44.924451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 351/673] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:44 2022] GET /compute/v2.1/servers/e1e61cdb-828c-466f-b7ca-7bbd7df3ea43 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:38:45.090159 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-10dd95c3-0846-4d97-a797-c304268b78f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:45.104909 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-10dd95c3-0846-4d97-a797-c304268b78f9 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1721 microversion: 2.1 time: 0.319768 Sep 01 16:38:45.105844 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 323/674] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:44 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1721 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:45.186375 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-50da893e-a3b4-4dfa-9384-7355ad8be05b req-84ab19ed-a7ba-4553-a86e-44455122bab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0958ba3f-7f1d-4fa1-bff7-4459d3945b6f", "name": "network-vif-deleted", "tag": "46daf8ff-8552-45e4-b4ac-b60b47e199de"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:45.196500 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-50da893e-a3b4-4dfa-9384-7355ad8be05b req-84ab19ed-a7ba-4553-a86e-44455122bab7 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:45.196970 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-50da893e-a3b4-4dfa-9384-7355ad8be05b req-84ab19ed-a7ba-4553-a86e-44455122bab7 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:45.197596 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-50da893e-a3b4-4dfa-9384-7355ad8be05b req-84ab19ed-a7ba-4553-a86e-44455122bab7 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:45.202184 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:45.211392 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-50da893e-a3b4-4dfa-9384-7355ad8be05b req-84ab19ed-a7ba-4553-a86e-44455122bab7 service nova] Creating event network-vif-deleted:46daf8ff-8552-45e4-b4ac-b60b47e199de for instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f on hv-cinder-85220 Sep 01 16:38:45.216991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-50da893e-a3b4-4dfa-9384-7355ad8be05b req-84ab19ed-a7ba-4553-a86e-44455122bab7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034055 Sep 01 16:38:45.218616 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 352/675] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:45.893340 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7a15dd8e-c73a-4c0a-b7c1-fa3c569cf2b8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:45.894324 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7a15dd8e-c73a-4c0a-b7c1-fa3c569cf2b8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:45.901223 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7a15dd8e-c73a-4c0a-b7c1-fa3c569cf2b8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:45.901702 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7a15dd8e-c73a-4c0a-b7c1-fa3c569cf2b8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:45.902134 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7a15dd8e-c73a-4c0a-b7c1-fa3c569cf2b8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:45.902851 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7a15dd8e-c73a-4c0a-b7c1-fa3c569cf2b8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:45.903296 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7a15dd8e-c73a-4c0a-b7c1-fa3c569cf2b8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:45.903717 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7a15dd8e-c73a-4c0a-b7c1-fa3c569cf2b8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:45.917056 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-7a15dd8e-c73a-4c0a-b7c1-fa3c569cf2b8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] HTTP exception thrown: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7a15dd8e-c73a-4c0a-b7c1-fa3c569cf2b8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Request method failure captured: Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f HTTP/1.1 Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN79ERR9fLbUahRSJk7hXfL4HJawIv21RX2LwoCzw1DEFNoHcT34R9AsgzMn4RQvNl33D6y-6Frlt-3D3AT2ZfUvg-AFa7Wzdy028iI5B1c-4YbxoBqt6o1jOGMNwJNkUd1i7gMBmqBTOGuupVNlC3UrybOQMhnYiBkYv1-EQ8x2DyI Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: cfb0b630e22745e8af15fb02c71800c3 Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:38:45.918734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:38:45.921946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:38:45.921946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:38:45.921946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: cfb0b630e22745e8af15fb02c71800c3 Sep 01 16:38:45.921946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:38:45.921946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-AttachVolumeShelveTestJSON-1886242538-project Sep 01 16:38:45.921946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:38:45.921946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:38:45.921946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: 8388303f9098497bb559b3bcb59fab52 Sep 01 16:38:45.921946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1886242538-project Sep 01 16:38:45.921946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:38:45.921946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. Sep 01 16:38:45.921946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': '0958ba3f-7f1d-4fa1-bff7-4459d3945b6f'} Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:38:45.923530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. Sep 01 16:38:45.925873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:38:45.927965 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7a15dd8e-c73a-4c0a-b7c1-fa3c569cf2b8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Returning 404 to user: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:38:45.927965 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7a15dd8e-c73a-4c0a-b7c1-fa3c569cf2b8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 404 len: 111 microversion: 2.20 time: 0.031721 Sep 01 16:38:45.927965 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 324/676] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:45 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 16:38:45.932855 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2e2cf663-2668-4e31-a73a-1afb1fd88e8a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '.version_select at 0x7feeec07c700>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:45.952975 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2e2cf663-2668-4e31-a73a-1afb1fd88e8a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1154839340" status: 204 len: 0 microversion: 2.20 time: 0.025257 Sep 01 16:38:45.953544 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 353/677] 10.222.0.18 () {60 vars in 1262 bytes} [Thu Sep 1 16:38:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1154839340 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 16:38:46.127553 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-9d200e7a-bc7c-4e8d-9e60-0846366fe410 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:46.128167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-9d200e7a-bc7c-4e8d-9e60-0846366fe410 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:46.138670 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d200e7a-bc7c-4e8d-9e60-0846366fe410 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:46.139442 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d200e7a-bc7c-4e8d-9e60-0846366fe410 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:46.140575 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d200e7a-bc7c-4e8d-9e60-0846366fe410 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:46.141447 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d200e7a-bc7c-4e8d-9e60-0846366fe410 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:46.142260 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d200e7a-bc7c-4e8d-9e60-0846366fe410 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:46.142689 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d200e7a-bc7c-4e8d-9e60-0846366fe410 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:46.401930 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9d200e7a-bc7c-4e8d-9e60-0846366fe410 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:46.407641 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:46.416689 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-9d200e7a-bc7c-4e8d-9e60-0846366fe410 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1721 microversion: 2.1 time: 0.292648 Sep 01 16:38:46.417594 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 325/678] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:46 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1721 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:46.759434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-56b71c1c-0ab8-4ae2-8d70-89c648aff76a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Action: 'create', calling method: .version_select at 0x7feeec04b310>, body: {"keypair": {"name": "tempest-keypair-1369706642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGUyOUDXxzS+O/9NS48DJG3t9DMgoEfInCPyU0ADkIp2i5alNlvyQ3fHUxHXvjX1hLi2XOVNWvGDevQv9g7CNCighcOQXsEW/97xxMWxjNbt+x/p73n7laloTVz7eysPg=="}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:46.775562 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-56b71c1c-0ab8-4ae2-8d70-89c648aff76a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Getting quotas for project cfb0b630e22745e8af15fb02c71800c3. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:38:46.779499 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-56b71c1c-0ab8-4ae2-8d70-89c648aff76a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Getting quotas for user 8388303f9098497bb559b3bcb59fab52 and project cfb0b630e22745e8af15fb02c71800c3. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:38:46.801894 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-56b71c1c-0ab8-4ae2-8d70-89c648aff76a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046619 Sep 01 16:38:46.802551 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 354/679] 10.222.0.18 () {62 vars in 1200 bytes} [Thu Sep 1 16:38:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 01 16:38:47.439691 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e3fbf5a2-2901-4e8c-b62c-ef909bde721d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:47.440529 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-e3fbf5a2-2901-4e8c-b62c-ef909bde721d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:47.447468 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e3fbf5a2-2901-4e8c-b62c-ef909bde721d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:47.447985 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e3fbf5a2-2901-4e8c-b62c-ef909bde721d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:47.448461 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e3fbf5a2-2901-4e8c-b62c-ef909bde721d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:47.449123 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e3fbf5a2-2901-4e8c-b62c-ef909bde721d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:47.449643 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e3fbf5a2-2901-4e8c-b62c-ef909bde721d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:47.450028 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e3fbf5a2-2901-4e8c-b62c-ef909bde721d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:47.660280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e3fbf5a2-2901-4e8c-b62c-ef909bde721d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:47.669694 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-e3fbf5a2-2901-4e8c-b62c-ef909bde721d tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1721 microversion: 2.1 time: 0.234506 Sep 01 16:38:47.670418 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 326/680] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:47 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:48.212597 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1689749523", "imageRef": "46185d58-0d47-4c97-b590-0f4434aa5c9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e2386a0-52ae-4650-b501-6e8c6cdd7cc9"}], "security_groups": [{"name": "tempest-securitygroup--322573793"}], "key_name": "tempest-keypair-1369706642", "user_data": "}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:48.316543 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] validate_networks() for [('1e2386a0-52ae-4650-b501-6e8c6cdd7cc9', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:38:48.693096 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:38:48.693260 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-427aa513-7718-4453-a07d-ba6fe35c2b82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:48.693725 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:38:48.694034 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-427aa513-7718-4453-a07d-ba6fe35c2b82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:48.694294 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:38:48.694792 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:38:48.695250 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:38:48.700810 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-427aa513-7718-4453-a07d-ba6fe35c2b82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:48.701281 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-427aa513-7718-4453-a07d-ba6fe35c2b82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:48.701726 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-427aa513-7718-4453-a07d-ba6fe35c2b82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:48.702446 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-427aa513-7718-4453-a07d-ba6fe35c2b82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:48.702894 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-427aa513-7718-4453-a07d-ba6fe35c2b82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:48.703305 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-427aa513-7718-4453-a07d-ba6fe35c2b82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:48.704927 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:48.705406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:48.705835 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:48.706588 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:48.707045 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:48.707473 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:48.726695 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Getting quotas for project cfb0b630e22745e8af15fb02c71800c3. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:38:48.731542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Getting quotas for user 8388303f9098497bb559b3bcb59fab52 and project cfb0b630e22745e8af15fb02c71800c3. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:38:48.743907 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:38:48.746604 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46185d58-0d47-4c97-b590-0f4434aa5c9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:38:48.798549 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-50f4a927-1b20-4952-8a4e-cb230f5bcf1e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.590443 Sep 01 16:38:48.799890 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 355/681] 10.222.0.18 () {62 vars in 1188 bytes} [Thu Sep 1 16:38:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 16:38:48.816103 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-787f815a-a24f-4955-aec5-df90487d578d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:48.819081 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-787f815a-a24f-4955-aec5-df90487d578d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:48.863617 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-427aa513-7718-4453-a07d-ba6fe35c2b82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:48.878024 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-427aa513-7718-4453-a07d-ba6fe35c2b82 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1721 microversion: 2.1 time: 0.188787 Sep 01 16:38:48.879418 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 327/682] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:48 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:48.898489 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-787f815a-a24f-4955-aec5-df90487d578d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:48.907902 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-787f815a-a24f-4955-aec5-df90487d578d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:48.909396 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-787f815a-a24f-4955-aec5-df90487d578d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:48.911146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-787f815a-a24f-4955-aec5-df90487d578d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1282 microversion: 2.20 time: 0.103853 Sep 01 16:38:48.911988 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 356/683] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:48 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:49.900954 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6d13d4fa-917c-427f-88a5-e493e0640dcf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:49.901798 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-6d13d4fa-917c-427f-88a5-e493e0640dcf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:49.910965 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6d13d4fa-917c-427f-88a5-e493e0640dcf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:49.911590 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6d13d4fa-917c-427f-88a5-e493e0640dcf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:49.912206 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6d13d4fa-917c-427f-88a5-e493e0640dcf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:49.913054 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6d13d4fa-917c-427f-88a5-e493e0640dcf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:49.913768 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6d13d4fa-917c-427f-88a5-e493e0640dcf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:49.914420 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6d13d4fa-917c-427f-88a5-e493e0640dcf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:49.939895 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1977e2ee-6ae5-4ee0-8a5a-932043e95d78 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:49.941022 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1977e2ee-6ae5-4ee0-8a5a-932043e95d78 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:49.944924 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:49.956320 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1977e2ee-6ae5-4ee0-8a5a-932043e95d78 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:49.957850 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1977e2ee-6ae5-4ee0-8a5a-932043e95d78 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:49.959028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1977e2ee-6ae5-4ee0-8a5a-932043e95d78 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:49.963326 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1977e2ee-6ae5-4ee0-8a5a-932043e95d78 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:49.963820 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1977e2ee-6ae5-4ee0-8a5a-932043e95d78 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:49.964615 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1977e2ee-6ae5-4ee0-8a5a-932043e95d78 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:50.128328 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-6d13d4fa-917c-427f-88a5-e493e0640dcf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:50.138498 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-6d13d4fa-917c-427f-88a5-e493e0640dcf tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1727 microversion: 2.1 time: 0.241291 Sep 01 16:38:50.139012 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 328/684] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:49 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1727 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:50.161418 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e0c9b840-8192-46cf-bfe3-e16c38272c11 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:50.161916 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-e0c9b840-8192-46cf-bfe3-e16c38272c11 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:50.169330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e0c9b840-8192-46cf-bfe3-e16c38272c11 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:50.169939 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e0c9b840-8192-46cf-bfe3-e16c38272c11 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:50.170476 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e0c9b840-8192-46cf-bfe3-e16c38272c11 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:50.171348 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e0c9b840-8192-46cf-bfe3-e16c38272c11 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:50.171858 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e0c9b840-8192-46cf-bfe3-e16c38272c11 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:50.172386 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e0c9b840-8192-46cf-bfe3-e16c38272c11 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:50.264331 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-e0c9b840-8192-46cf-bfe3-e16c38272c11 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107290 Sep 01 16:38:50.265420 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 329/685] 10.222.0.18 () {58 vars in 1275 bytes} [Thu Sep 1 16:38:50 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:38:50.302755 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1977e2ee-6ae5-4ee0-8a5a-932043e95d78 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:50.312846 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1977e2ee-6ae5-4ee0-8a5a-932043e95d78 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:50.314498 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1977e2ee-6ae5-4ee0-8a5a-932043e95d78 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:50.315917 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1977e2ee-6ae5-4ee0-8a5a-932043e95d78 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1334 microversion: 2.20 time: 0.382672 Sep 01 16:38:50.316504 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 357/686] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:49 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1334 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:51.346967 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-56aa5835-54f4-4a18-a7dd-eca6c198f878 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:51.348293 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-56aa5835-54f4-4a18-a7dd-eca6c198f878 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:51.356046 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-56aa5835-54f4-4a18-a7dd-eca6c198f878 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:51.356747 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-56aa5835-54f4-4a18-a7dd-eca6c198f878 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:51.357181 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-56aa5835-54f4-4a18-a7dd-eca6c198f878 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:51.357881 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-56aa5835-54f4-4a18-a7dd-eca6c198f878 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:51.358387 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-56aa5835-54f4-4a18-a7dd-eca6c198f878 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:51.359335 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-56aa5835-54f4-4a18-a7dd-eca6c198f878 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:51.460249 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-56aa5835-54f4-4a18-a7dd-eca6c198f878 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:51.469765 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-56aa5835-54f4-4a18-a7dd-eca6c198f878 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:51.471676 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-56aa5835-54f4-4a18-a7dd-eca6c198f878 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:51.473055 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-56aa5835-54f4-4a18-a7dd-eca6c198f878 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1340 microversion: 2.20 time: 0.130794 Sep 01 16:38:51.474120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 330/687] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:51 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1340 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:51.764597 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-c4432bbc-9674-484f-989f-59ffbadf88e8 req-d2358198-633e-4db8-84e4-2eb1adc45917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f1e8ce-fea9-426e-8ce0-23b9f7851b4e", "tag": "2b174a59-f0a9-4b1a-9233-ea65d28a5d38"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:51.786181 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-c4432bbc-9674-484f-989f-59ffbadf88e8 req-d2358198-633e-4db8-84e4-2eb1adc45917 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:51.787756 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-c4432bbc-9674-484f-989f-59ffbadf88e8 req-d2358198-633e-4db8-84e4-2eb1adc45917 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:51.788500 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-c4432bbc-9674-484f-989f-59ffbadf88e8 req-d2358198-633e-4db8-84e4-2eb1adc45917 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:51.806418 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-c4432bbc-9674-484f-989f-59ffbadf88e8 req-d2358198-633e-4db8-84e4-2eb1adc45917 service nova] Creating event network-changed:2b174a59-f0a9-4b1a-9233-ea65d28a5d38 for instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e on hv-cinder-85220 Sep 01 16:38:51.814014 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-c4432bbc-9674-484f-989f-59ffbadf88e8 req-d2358198-633e-4db8-84e4-2eb1adc45917 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059427 Sep 01 16:38:51.815035 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 358/688] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:52.496859 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-602f0b14-2b91-4939-b5e6-5ea38a727d29 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:52.498256 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-602f0b14-2b91-4939-b5e6-5ea38a727d29 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:52.524778 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-602f0b14-2b91-4939-b5e6-5ea38a727d29 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:52.525628 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-602f0b14-2b91-4939-b5e6-5ea38a727d29 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:52.526345 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-602f0b14-2b91-4939-b5e6-5ea38a727d29 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:52.527283 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-602f0b14-2b91-4939-b5e6-5ea38a727d29 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:52.530037 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-602f0b14-2b91-4939-b5e6-5ea38a727d29 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:52.530882 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-602f0b14-2b91-4939-b5e6-5ea38a727d29 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:52.872142 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-602f0b14-2b91-4939-b5e6-5ea38a727d29 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:52.881262 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-602f0b14-2b91-4939-b5e6-5ea38a727d29 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:52.882971 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-602f0b14-2b91-4939-b5e6-5ea38a727d29 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:52.884113 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-602f0b14-2b91-4939-b5e6-5ea38a727d29 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1407 microversion: 2.20 time: 0.391523 Sep 01 16:38:52.884913 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 331/689] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:52 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1407 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:53.832229 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-d452e4ac-0243-44fc-aded-fd284d0150fb req-63618876-002f-4d34-a870-bbf9cd485255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f1e8ce-fea9-426e-8ce0-23b9f7851b4e", "tag": "2b174a59-f0a9-4b1a-9233-ea65d28a5d38"}, {"name": "network-changed", "server_uuid": "7d764e51-5b8a-4d17-886e-b52189448293", "tag": "5bb9e1c4-5809-406a-8024-a9bfe99bb842"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:53.842730 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-d452e4ac-0243-44fc-aded-fd284d0150fb req-63618876-002f-4d34-a870-bbf9cd485255 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:53.843693 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-d452e4ac-0243-44fc-aded-fd284d0150fb req-63618876-002f-4d34-a870-bbf9cd485255 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:53.844115 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-d452e4ac-0243-44fc-aded-fd284d0150fb req-63618876-002f-4d34-a870-bbf9cd485255 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:53.856870 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-d452e4ac-0243-44fc-aded-fd284d0150fb req-63618876-002f-4d34-a870-bbf9cd485255 service nova] Creating event network-changed:2b174a59-f0a9-4b1a-9233-ea65d28a5d38 for instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e on hv-cinder-85220 Sep 01 16:38:53.857312 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-d452e4ac-0243-44fc-aded-fd284d0150fb req-63618876-002f-4d34-a870-bbf9cd485255 service nova] Creating event network-changed:5bb9e1c4-5809-406a-8024-a9bfe99bb842 for instance 7d764e51-5b8a-4d17-886e-b52189448293 on hv-cinder-85220 Sep 01 16:38:53.864211 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-d452e4ac-0243-44fc-aded-fd284d0150fb req-63618876-002f-4d34-a870-bbf9cd485255 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036445 Sep 01 16:38:53.864806 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 359/690] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:53.908427 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-87ebb849-c012-43ef-8f0b-58dbb965b880 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:53.909064 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-87ebb849-c012-43ef-8f0b-58dbb965b880 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:53.916192 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-87ebb849-c012-43ef-8f0b-58dbb965b880 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:53.916719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-87ebb849-c012-43ef-8f0b-58dbb965b880 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:53.917226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-87ebb849-c012-43ef-8f0b-58dbb965b880 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:53.917983 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-87ebb849-c012-43ef-8f0b-58dbb965b880 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:53.918475 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-87ebb849-c012-43ef-8f0b-58dbb965b880 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:53.918897 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-87ebb849-c012-43ef-8f0b-58dbb965b880 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:54.068553 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-87ebb849-c012-43ef-8f0b-58dbb965b880 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:54.077295 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-87ebb849-c012-43ef-8f0b-58dbb965b880 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:54.078770 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-87ebb849-c012-43ef-8f0b-58dbb965b880 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:54.079891 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-87ebb849-c012-43ef-8f0b-58dbb965b880 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1407 microversion: 2.20 time: 0.176550 Sep 01 16:38:54.080460 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 332/691] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:53 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:55.104504 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-de6bf086-c2e6-47e3-a48b-8ba0d000c15e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:55.105198 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-de6bf086-c2e6-47e3-a48b-8ba0d000c15e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:55.111850 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de6bf086-c2e6-47e3-a48b-8ba0d000c15e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:55.112327 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de6bf086-c2e6-47e3-a48b-8ba0d000c15e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:55.112757 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de6bf086-c2e6-47e3-a48b-8ba0d000c15e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:55.113440 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de6bf086-c2e6-47e3-a48b-8ba0d000c15e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:55.113885 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de6bf086-c2e6-47e3-a48b-8ba0d000c15e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:55.114334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de6bf086-c2e6-47e3-a48b-8ba0d000c15e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:55.349990 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-de6bf086-c2e6-47e3-a48b-8ba0d000c15e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:55.358047 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-de6bf086-c2e6-47e3-a48b-8ba0d000c15e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:55.359596 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-de6bf086-c2e6-47e3-a48b-8ba0d000c15e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:55.360683 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-de6bf086-c2e6-47e3-a48b-8ba0d000c15e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1407 microversion: 2.20 time: 0.261205 Sep 01 16:38:55.361231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 360/692] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:55 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:56.383672 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-9d05f36d-045c-45d5-9731-0f2cefebac32 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:56.384266 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-9d05f36d-045c-45d5-9731-0f2cefebac32 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:56.391303 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d05f36d-045c-45d5-9731-0f2cefebac32 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:56.391769 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d05f36d-045c-45d5-9731-0f2cefebac32 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:56.392190 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d05f36d-045c-45d5-9731-0f2cefebac32 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:56.392861 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d05f36d-045c-45d5-9731-0f2cefebac32 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:56.393298 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d05f36d-045c-45d5-9731-0f2cefebac32 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:56.393712 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d05f36d-045c-45d5-9731-0f2cefebac32 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:56.571910 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9d05f36d-045c-45d5-9731-0f2cefebac32 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:56.580646 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9d05f36d-045c-45d5-9731-0f2cefebac32 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:56.582076 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9d05f36d-045c-45d5-9731-0f2cefebac32 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:56.583200 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-9d05f36d-045c-45d5-9731-0f2cefebac32 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1407 microversion: 2.20 time: 0.203810 Sep 01 16:38:56.583752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 333/693] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:56 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:57.606063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-45bcbe36-f5bd-4c91-8340-6a5940712b97 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:57.606836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-45bcbe36-f5bd-4c91-8340-6a5940712b97 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:57.614377 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45bcbe36-f5bd-4c91-8340-6a5940712b97 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:57.614852 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45bcbe36-f5bd-4c91-8340-6a5940712b97 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:57.615272 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45bcbe36-f5bd-4c91-8340-6a5940712b97 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:57.615955 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45bcbe36-f5bd-4c91-8340-6a5940712b97 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:57.616391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45bcbe36-f5bd-4c91-8340-6a5940712b97 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:57.616833 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45bcbe36-f5bd-4c91-8340-6a5940712b97 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:57.749974 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-45bcbe36-f5bd-4c91-8340-6a5940712b97 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:57.758566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-45bcbe36-f5bd-4c91-8340-6a5940712b97 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:57.760001 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-45bcbe36-f5bd-4c91-8340-6a5940712b97 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:57.761100 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-45bcbe36-f5bd-4c91-8340-6a5940712b97 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1407 microversion: 2.20 time: 0.158954 Sep 01 16:38:57.761646 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 361/694] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:57 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:58.789880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-145e3eab-d5e0-4b9f-816a-55aac3e645ac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:58.790522 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-145e3eab-d5e0-4b9f-816a-55aac3e645ac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:58.797462 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-145e3eab-d5e0-4b9f-816a-55aac3e645ac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:58.797938 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-145e3eab-d5e0-4b9f-816a-55aac3e645ac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:58.798397 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-145e3eab-d5e0-4b9f-816a-55aac3e645ac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:58.799075 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-145e3eab-d5e0-4b9f-816a-55aac3e645ac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:58.799523 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-145e3eab-d5e0-4b9f-816a-55aac3e645ac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:58.799941 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-145e3eab-d5e0-4b9f-816a-55aac3e645ac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:58.924933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-145e3eab-d5e0-4b9f-816a-55aac3e645ac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:58.932959 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-145e3eab-d5e0-4b9f-816a-55aac3e645ac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:58.934495 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-145e3eab-d5e0-4b9f-816a-55aac3e645ac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:58.935615 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-145e3eab-d5e0-4b9f-816a-55aac3e645ac tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1407 microversion: 2.20 time: 0.149690 Sep 01 16:38:58.936161 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 334/695] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:58 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:59.960122 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f47c2876-7c13-4a9a-8828-ba791fe8b415 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:59.960669 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f47c2876-7c13-4a9a-8828-ba791fe8b415 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:59.963056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:59.963750 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=12 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:59.969849 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f47c2876-7c13-4a9a-8828-ba791fe8b415 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:59.970351 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f47c2876-7c13-4a9a-8828-ba791fe8b415 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:59.970784 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f47c2876-7c13-4a9a-8828-ba791fe8b415 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:59.971521 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f47c2876-7c13-4a9a-8828-ba791fe8b415 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:59.972058 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f47c2876-7c13-4a9a-8828-ba791fe8b415 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:59.972457 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f47c2876-7c13-4a9a-8828-ba791fe8b415 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:00.104059 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f47c2876-7c13-4a9a-8828-ba791fe8b415 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:00.112783 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f47c2876-7c13-4a9a-8828-ba791fe8b415 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:00.114207 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f47c2876-7c13-4a9a-8828-ba791fe8b415 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:00.115342 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f47c2876-7c13-4a9a-8828-ba791fe8b415 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1407 microversion: 2.20 time: 0.159165 Sep 01 16:39:00.115893 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 362/696] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:59 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:01.137795 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-48a12130-2de5-46f0-b2ae-5fb8e56b6a68 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:01.138421 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-48a12130-2de5-46f0-b2ae-5fb8e56b6a68 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:01.144739 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48a12130-2de5-46f0-b2ae-5fb8e56b6a68 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:01.145224 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48a12130-2de5-46f0-b2ae-5fb8e56b6a68 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:01.145653 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48a12130-2de5-46f0-b2ae-5fb8e56b6a68 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:01.146370 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48a12130-2de5-46f0-b2ae-5fb8e56b6a68 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:01.146818 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48a12130-2de5-46f0-b2ae-5fb8e56b6a68 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:01.147236 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48a12130-2de5-46f0-b2ae-5fb8e56b6a68 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:01.274691 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-48a12130-2de5-46f0-b2ae-5fb8e56b6a68 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:01.283162 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-48a12130-2de5-46f0-b2ae-5fb8e56b6a68 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:01.284587 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-48a12130-2de5-46f0-b2ae-5fb8e56b6a68 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:01.285673 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-48a12130-2de5-46f0-b2ae-5fb8e56b6a68 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1407 microversion: 2.20 time: 0.151808 Sep 01 16:39:01.286228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 335/697] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:01 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:01.553769 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-9fe306d6-5ea1-4d04-a973-c272b26e4498 req-d578d5b2-063c-4dcc-9e2e-0a0fd26dde05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d764e51-5b8a-4d17-886e-b52189448293", "name": "network-vif-plugged", "status": "completed", "tag": "5bb9e1c4-5809-406a-8024-a9bfe99bb842"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:01.563911 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-9fe306d6-5ea1-4d04-a973-c272b26e4498 req-d578d5b2-063c-4dcc-9e2e-0a0fd26dde05 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:01.564378 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-9fe306d6-5ea1-4d04-a973-c272b26e4498 req-d578d5b2-063c-4dcc-9e2e-0a0fd26dde05 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:01.564806 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-9fe306d6-5ea1-4d04-a973-c272b26e4498 req-d578d5b2-063c-4dcc-9e2e-0a0fd26dde05 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:01.575778 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-9fe306d6-5ea1-4d04-a973-c272b26e4498 req-d578d5b2-063c-4dcc-9e2e-0a0fd26dde05 service nova] Creating event network-vif-plugged:5bb9e1c4-5809-406a-8024-a9bfe99bb842 for instance 7d764e51-5b8a-4d17-886e-b52189448293 on hv-cinder-85220 Sep 01 16:39:01.581046 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-9fe306d6-5ea1-4d04-a973-c272b26e4498 req-d578d5b2-063c-4dcc-9e2e-0a0fd26dde05 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030868 Sep 01 16:39:01.581609 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 363/698] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:02.308845 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ebb2ad5f-e563-4a39-bf44-f7706d95afe7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:02.309360 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ebb2ad5f-e563-4a39-bf44-f7706d95afe7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:02.316263 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ebb2ad5f-e563-4a39-bf44-f7706d95afe7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:02.316729 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ebb2ad5f-e563-4a39-bf44-f7706d95afe7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:02.317151 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ebb2ad5f-e563-4a39-bf44-f7706d95afe7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:02.317966 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ebb2ad5f-e563-4a39-bf44-f7706d95afe7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:02.318463 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ebb2ad5f-e563-4a39-bf44-f7706d95afe7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:02.318879 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ebb2ad5f-e563-4a39-bf44-f7706d95afe7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:02.447942 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ebb2ad5f-e563-4a39-bf44-f7706d95afe7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:02.456403 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ebb2ad5f-e563-4a39-bf44-f7706d95afe7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:02.457830 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ebb2ad5f-e563-4a39-bf44-f7706d95afe7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:02.458967 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ebb2ad5f-e563-4a39-bf44-f7706d95afe7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1407 microversion: 2.20 time: 0.154431 Sep 01 16:39:02.459522 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 336/699] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:02 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:03.484073 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9dc5f315-b718-45fd-b7dd-bd7b298bf190 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:03.484735 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9dc5f315-b718-45fd-b7dd-bd7b298bf190 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:03.491020 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9dc5f315-b718-45fd-b7dd-bd7b298bf190 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:03.491501 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9dc5f315-b718-45fd-b7dd-bd7b298bf190 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:03.492014 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9dc5f315-b718-45fd-b7dd-bd7b298bf190 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:03.492730 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9dc5f315-b718-45fd-b7dd-bd7b298bf190 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:03.493178 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9dc5f315-b718-45fd-b7dd-bd7b298bf190 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:03.493598 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9dc5f315-b718-45fd-b7dd-bd7b298bf190 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:03.622964 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9dc5f315-b718-45fd-b7dd-bd7b298bf190 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:03.631472 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9dc5f315-b718-45fd-b7dd-bd7b298bf190 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:03.632918 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9dc5f315-b718-45fd-b7dd-bd7b298bf190 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:03.634222 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9dc5f315-b718-45fd-b7dd-bd7b298bf190 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1599 microversion: 2.20 time: 0.155413 Sep 01 16:39:03.634840 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 364/700] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:03 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:39:03.656665 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-9d60056f-9117-4cd2-9ae5-245efdf7a183 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:03.657165 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-9d60056f-9117-4cd2-9ae5-245efdf7a183 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:03.663681 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d60056f-9117-4cd2-9ae5-245efdf7a183 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:03.664154 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d60056f-9117-4cd2-9ae5-245efdf7a183 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:03.664579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d60056f-9117-4cd2-9ae5-245efdf7a183 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:03.665255 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d60056f-9117-4cd2-9ae5-245efdf7a183 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:03.665697 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d60056f-9117-4cd2-9ae5-245efdf7a183 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:03.666112 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9d60056f-9117-4cd2-9ae5-245efdf7a183 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:03.741235 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-9d60056f-9117-4cd2-9ae5-245efdf7a183 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088504 Sep 01 16:39:03.741821 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 337/701] 10.222.0.18 () {60 vars in 1316 bytes} [Thu Sep 1 16:39:03 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:39:04.941687 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-ff9475ed-71d6-4a49-8dbb-e04d7756caf1 req-9b1454c7-8a15-412d-9fd0-63fe962bc460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d764e51-5b8a-4d17-886e-b52189448293", "tag": "5bb9e1c4-5809-406a-8024-a9bfe99bb842"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:04.951546 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-ff9475ed-71d6-4a49-8dbb-e04d7756caf1 req-9b1454c7-8a15-412d-9fd0-63fe962bc460 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:04.952818 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-ff9475ed-71d6-4a49-8dbb-e04d7756caf1 req-9b1454c7-8a15-412d-9fd0-63fe962bc460 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:04.953248 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-ff9475ed-71d6-4a49-8dbb-e04d7756caf1 req-9b1454c7-8a15-412d-9fd0-63fe962bc460 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:04.964638 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-ff9475ed-71d6-4a49-8dbb-e04d7756caf1 req-9b1454c7-8a15-412d-9fd0-63fe962bc460 service nova] Creating event network-changed:5bb9e1c4-5809-406a-8024-a9bfe99bb842 for instance 7d764e51-5b8a-4d17-886e-b52189448293 on hv-cinder-85220 Sep 01 16:39:04.971371 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-ff9475ed-71d6-4a49-8dbb-e04d7756caf1 req-9b1454c7-8a15-412d-9fd0-63fe962bc460 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033268 Sep 01 16:39:04.972209 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 365/702] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:12.042927 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-898ac01a-6ae3-422e-b8dc-14c2df6bd5a5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:12.045129 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-898ac01a-6ae3-422e-b8dc-14c2df6bd5a5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:12.047778 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:12.052886 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-898ac01a-6ae3-422e-b8dc-14c2df6bd5a5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:12.053354 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-898ac01a-6ae3-422e-b8dc-14c2df6bd5a5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:12.053779 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-898ac01a-6ae3-422e-b8dc-14c2df6bd5a5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:12.054484 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-898ac01a-6ae3-422e-b8dc-14c2df6bd5a5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:12.054925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-898ac01a-6ae3-422e-b8dc-14c2df6bd5a5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:12.055340 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-898ac01a-6ae3-422e-b8dc-14c2df6bd5a5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:12.083391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-898ac01a-6ae3-422e-b8dc-14c2df6bd5a5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045378 Sep 01 16:39:12.083929 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 338/703] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:39:12 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:39:12.146463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-69dba6c7-9e84-4624-8610-ce689d339bfd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:12.147100 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-69dba6c7-9e84-4624-8610-ce689d339bfd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:12.153286 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-69dba6c7-9e84-4624-8610-ce689d339bfd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:12.153758 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-69dba6c7-9e84-4624-8610-ce689d339bfd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:12.154179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-69dba6c7-9e84-4624-8610-ce689d339bfd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:12.155485 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-69dba6c7-9e84-4624-8610-ce689d339bfd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:12.155934 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-69dba6c7-9e84-4624-8610-ce689d339bfd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:12.156352 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-69dba6c7-9e84-4624-8610-ce689d339bfd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:12.180326 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-69dba6c7-9e84-4624-8610-ce689d339bfd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:39:12.252564 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-69dba6c7-9e84-4624-8610-ce689d339bfd tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 204 len: 0 microversion: 2.1 time: 0.111069 Sep 01 16:39:12.253392 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 366/704] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:39:12 2022] DELETE /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:39:12.262346 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-8097f316-fddf-420c-8910-4d5db2f5e81a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:12.262955 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-8097f316-fddf-420c-8910-4d5db2f5e81a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:12.269461 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8097f316-fddf-420c-8910-4d5db2f5e81a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:12.269941 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8097f316-fddf-420c-8910-4d5db2f5e81a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:12.270562 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8097f316-fddf-420c-8910-4d5db2f5e81a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:12.271094 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8097f316-fddf-420c-8910-4d5db2f5e81a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:12.271573 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8097f316-fddf-420c-8910-4d5db2f5e81a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:12.271995 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8097f316-fddf-420c-8910-4d5db2f5e81a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:12.398457 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-8097f316-fddf-420c-8910-4d5db2f5e81a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:12.406676 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-8097f316-fddf-420c-8910-4d5db2f5e81a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1672 microversion: 2.1 time: 0.148230 Sep 01 16:39:12.407239 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 339/705] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:12 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:13.428334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6b53b034-ee09-4250-812d-3546d88eeffb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:13.429039 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6b53b034-ee09-4250-812d-3546d88eeffb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:13.435931 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6b53b034-ee09-4250-812d-3546d88eeffb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:13.436408 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6b53b034-ee09-4250-812d-3546d88eeffb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:13.436838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6b53b034-ee09-4250-812d-3546d88eeffb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:13.437521 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6b53b034-ee09-4250-812d-3546d88eeffb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:13.437967 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6b53b034-ee09-4250-812d-3546d88eeffb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:13.438432 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6b53b034-ee09-4250-812d-3546d88eeffb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:13.568177 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6b53b034-ee09-4250-812d-3546d88eeffb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:13.576184 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6b53b034-ee09-4250-812d-3546d88eeffb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1672 microversion: 2.1 time: 0.152210 Sep 01 16:39:13.576762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 367/706] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:13 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:14.597586 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-32a85fe6-0219-4b90-a1f9-a40f0d880371 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:14.598180 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-32a85fe6-0219-4b90-a1f9-a40f0d880371 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:14.605057 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32a85fe6-0219-4b90-a1f9-a40f0d880371 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:14.605525 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32a85fe6-0219-4b90-a1f9-a40f0d880371 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:14.605948 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32a85fe6-0219-4b90-a1f9-a40f0d880371 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:14.606648 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32a85fe6-0219-4b90-a1f9-a40f0d880371 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:14.607090 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32a85fe6-0219-4b90-a1f9-a40f0d880371 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:14.607505 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-32a85fe6-0219-4b90-a1f9-a40f0d880371 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:14.733745 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-32a85fe6-0219-4b90-a1f9-a40f0d880371 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:14.741380 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-32a85fe6-0219-4b90-a1f9-a40f0d880371 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1672 microversion: 2.1 time: 0.147654 Sep 01 16:39:14.741935 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 340/707] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:14 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:15.763398 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-31736f26-2d73-4c91-bc18-364db19ca551 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:15.763996 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-31736f26-2d73-4c91-bc18-364db19ca551 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:15.770602 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31736f26-2d73-4c91-bc18-364db19ca551 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:15.771077 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31736f26-2d73-4c91-bc18-364db19ca551 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:15.771497 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31736f26-2d73-4c91-bc18-364db19ca551 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:15.772177 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31736f26-2d73-4c91-bc18-364db19ca551 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:15.772615 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31736f26-2d73-4c91-bc18-364db19ca551 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:15.773024 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31736f26-2d73-4c91-bc18-364db19ca551 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:15.900386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-31736f26-2d73-4c91-bc18-364db19ca551 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:15.908043 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-31736f26-2d73-4c91-bc18-364db19ca551 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1672 microversion: 2.1 time: 0.148525 Sep 01 16:39:15.908599 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 368/708] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:15 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:16.929220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-0d71ff55-5b9d-4866-a93f-53127e569b8c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:16.929820 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0d71ff55-5b9d-4866-a93f-53127e569b8c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:16.936645 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0d71ff55-5b9d-4866-a93f-53127e569b8c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:16.937118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0d71ff55-5b9d-4866-a93f-53127e569b8c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:16.937546 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0d71ff55-5b9d-4866-a93f-53127e569b8c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:16.938219 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0d71ff55-5b9d-4866-a93f-53127e569b8c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:16.938685 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0d71ff55-5b9d-4866-a93f-53127e569b8c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:16.939098 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0d71ff55-5b9d-4866-a93f-53127e569b8c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:17.160111 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0d71ff55-5b9d-4866-a93f-53127e569b8c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:17.167756 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-0d71ff55-5b9d-4866-a93f-53127e569b8c tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1672 microversion: 2.1 time: 0.242353 Sep 01 16:39:17.168320 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 341/709] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:16 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1672 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:17.824482 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-0631c49a-df59-450c-8f8d-05819971d00d req-fd0e3879-9fd3-4ed9-b3ed-8ce1af8d857a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f220c0ef-c9c6-4fb0-995b-6daea95e841f", "name": "network-vif-deleted", "tag": "38cd1838-9a61-4f72-a995-2bc777df4564"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:17.837446 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-0631c49a-df59-450c-8f8d-05819971d00d req-fd0e3879-9fd3-4ed9-b3ed-8ce1af8d857a service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:17.837930 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-0631c49a-df59-450c-8f8d-05819971d00d req-fd0e3879-9fd3-4ed9-b3ed-8ce1af8d857a service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:17.838377 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-0631c49a-df59-450c-8f8d-05819971d00d req-fd0e3879-9fd3-4ed9-b3ed-8ce1af8d857a service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:17.842367 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:17.850480 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-0631c49a-df59-450c-8f8d-05819971d00d req-fd0e3879-9fd3-4ed9-b3ed-8ce1af8d857a service nova] Creating event network-vif-deleted:38cd1838-9a61-4f72-a995-2bc777df4564 for instance f220c0ef-c9c6-4fb0-995b-6daea95e841f on hv-cinder-85220 Sep 01 16:39:17.855348 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-0631c49a-df59-450c-8f8d-05819971d00d req-fd0e3879-9fd3-4ed9-b3ed-8ce1af8d857a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035213 Sep 01 16:39:17.856323 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 369/710] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:18.189619 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e4d8606e-d9e2-4cb7-8460-054fbe7f37b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:18.190167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-e4d8606e-d9e2-4cb7-8460-054fbe7f37b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:18.196514 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e4d8606e-d9e2-4cb7-8460-054fbe7f37b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:18.197000 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e4d8606e-d9e2-4cb7-8460-054fbe7f37b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:18.197435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e4d8606e-d9e2-4cb7-8460-054fbe7f37b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:18.198126 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e4d8606e-d9e2-4cb7-8460-054fbe7f37b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:18.198607 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e4d8606e-d9e2-4cb7-8460-054fbe7f37b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:18.199065 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e4d8606e-d9e2-4cb7-8460-054fbe7f37b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:18.203004 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=93 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:18.265628 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e4d8606e-d9e2-4cb7-8460-054fbe7f37b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:18.273660 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-e4d8606e-d9e2-4cb7-8460-054fbe7f37b9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1605 microversion: 2.1 time: 0.088555 Sep 01 16:39:18.274278 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 342/711] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:18 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1605 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:19.296770 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-691e2a9f-6b98-4901-ae35-38afe2967e60 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:19.297466 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-691e2a9f-6b98-4901-ae35-38afe2967e60 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:19.305160 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-691e2a9f-6b98-4901-ae35-38afe2967e60 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:19.305631 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-691e2a9f-6b98-4901-ae35-38afe2967e60 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:19.306056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-691e2a9f-6b98-4901-ae35-38afe2967e60 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:19.306756 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-691e2a9f-6b98-4901-ae35-38afe2967e60 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:19.307228 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-691e2a9f-6b98-4901-ae35-38afe2967e60 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:19.307643 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-691e2a9f-6b98-4901-ae35-38afe2967e60 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:19.375441 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-691e2a9f-6b98-4901-ae35-38afe2967e60 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:19.384441 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-691e2a9f-6b98-4901-ae35-38afe2967e60 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1605 microversion: 2.1 time: 0.092479 Sep 01 16:39:19.385130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 370/712] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:19 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1605 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:20.406963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-2810c2e1-cc91-4f8b-aa65-2f4919a46533 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:20.407561 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-2810c2e1-cc91-4f8b-aa65-2f4919a46533 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:20.414730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2810c2e1-cc91-4f8b-aa65-2f4919a46533 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:20.415213 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2810c2e1-cc91-4f8b-aa65-2f4919a46533 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:20.415645 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2810c2e1-cc91-4f8b-aa65-2f4919a46533 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:20.416331 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2810c2e1-cc91-4f8b-aa65-2f4919a46533 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:20.416778 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2810c2e1-cc91-4f8b-aa65-2f4919a46533 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:20.417200 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2810c2e1-cc91-4f8b-aa65-2f4919a46533 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:20.451596 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2810c2e1-cc91-4f8b-aa65-2f4919a46533 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:20.452078 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2810c2e1-cc91-4f8b-aa65-2f4919a46533 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:20.452517 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2810c2e1-cc91-4f8b-aa65-2f4919a46533 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:20.452960 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.objects.instance [None req-2810c2e1-cc91-4f8b-aa65-2f4919a46533 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lazy-loading 'fault' on Instance uuid f220c0ef-c9c6-4fb0-995b-6daea95e841f {{(pid=127178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:39:20.494703 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2810c2e1-cc91-4f8b-aa65-2f4919a46533 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:20.502988 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-2810c2e1-cc91-4f8b-aa65-2f4919a46533 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 200 len: 1327 microversion: 2.1 time: 0.100750 Sep 01 16:39:20.503578 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 343/713] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:20 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:21.523909 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7515b0cf-0562-41c4-8158-dd53123f3413 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:21.524516 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7515b0cf-0562-41c4-8158-dd53123f3413 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:21.527180 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:21.532912 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7515b0cf-0562-41c4-8158-dd53123f3413 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:21.533393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7515b0cf-0562-41c4-8158-dd53123f3413 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:21.533821 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7515b0cf-0562-41c4-8158-dd53123f3413 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:21.534591 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7515b0cf-0562-41c4-8158-dd53123f3413 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:21.535161 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7515b0cf-0562-41c4-8158-dd53123f3413 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:21.535587 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7515b0cf-0562-41c4-8158-dd53123f3413 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:21.550930 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-7515b0cf-0562-41c4-8158-dd53123f3413 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] HTTP exception thrown: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7515b0cf-0562-41c4-8158-dd53123f3413 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Request method failure captured: Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f HTTP/1.1 Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN8BAisc9tDZeX_1hRyjrfel6EzySTSdpIsiTzrOheWVN5nYSXDgHpk9Ift87hcqqBbIaN6Y5bvK9fVjZh8YIKPfaX66BP85jlsDOEOhoI-xgRPS8ArBAANwoZHGadv0p2sb8zEfYom6h9gQkqSaiLRWZAWrgGhoNrgq8gH-E9dM_co Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: aab96a55de014d8cac2c004ba7cadedd Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:39:21.552785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:39:21.554993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:39:21.554993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:39:21.554993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: aab96a55de014d8cac2c004ba7cadedd Sep 01 16:39:21.554993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:39:21.554993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeTestJSON-1785464243-project Sep 01 16:39:21.554993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:39:21.554993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:39:21.554993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: 73624e79ccdd4782beddf663bb6d02e1 Sep 01 16:39:21.554993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeTestJSON-1785464243-project Sep 01 16:39:21.554993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:39:21.554993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. Sep 01 16:39:21.554993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': 'f220c0ef-c9c6-4fb0-995b-6daea95e841f'} Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:39:21.556202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. Sep 01 16:39:21.558463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:39:21.560404 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7515b0cf-0562-41c4-8158-dd53123f3413 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Returning 404 to user: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:39:21.560404 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7515b0cf-0562-41c4-8158-dd53123f3413 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 404 len: 111 microversion: 2.1 time: 0.034127 Sep 01 16:39:21.560404 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 371/714] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:21 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:39:21.563361 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-8ad50f4f-abc9-4785-bca7-e98aad26422f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '.version_select at 0x7feeec182700>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:21.598406 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-8ad50f4f-abc9-4785-bca7-e98aad26422f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-718892069" status: 202 len: 0 microversion: 2.1 time: 0.038693 Sep 01 16:39:21.599657 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 344/715] 10.222.0.18 () {58 vars in 1218 bytes} [Thu Sep 1 16:39:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-718892069 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:39:22.258023 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c7f06945-c7aa-4ecc-99c7-f53b12761c7e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Action: 'create', calling method: .version_select at 0x7feeec0b3d30>, body: {"keypair": {"name": "tempest-keypair-1502619831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtDwzj1116s4D15eZNCfeWjFh9V04F7bu9AThmCcd4osb/NU656qNfO6S2ZmpxB3qXoi5I1JqQU45/MfogTTZL168WKYolT9zwheDOE9rC2K4ZFRhtDiRdVCbwrLuwrdA=="}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:22.276330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-c7f06945-c7aa-4ecc-99c7-f53b12761c7e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Getting quotas for project aab96a55de014d8cac2c004ba7cadedd. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:39:22.281032 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-c7f06945-c7aa-4ecc-99c7-f53b12761c7e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Getting quotas for user 73624e79ccdd4782beddf663bb6d02e1 and project aab96a55de014d8cac2c004ba7cadedd. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:39:22.303143 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c7f06945-c7aa-4ecc-99c7-f53b12761c7e tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048807 Sep 01 16:39:22.303843 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 372/716] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 1 16:39:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:23.515843 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-25633845", "imageRef": "46185d58-0d47-4c97-b590-0f4434aa5c9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba8f8151-1775-4d72-8643-4c1aec9c20a0"}], "security_groups": [{"name": "tempest-securitygroup--716066378"}], "key_name": "tempest-keypair-1502619831", "user_data": "}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:23.622876 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.network.neutron [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] validate_networks() for [('ba8f8151-1775-4d72-8643-4c1aec9c20a0', None, None, None, None, None)] {{(pid=127178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:39:24.101689 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Flavor limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:39:24.102107 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Image limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:39:24.102607 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Flavor pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:39:24.103012 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Image pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:39:24.103417 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:39:24.113371 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:24.113847 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:24.114320 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:24.115039 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:24.115488 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:24.115906 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:24.132351 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Getting quotas for project aab96a55de014d8cac2c004ba7cadedd. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:39:24.136268 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Getting quotas for user 73624e79ccdd4782beddf663bb6d02e1 and project aab96a55de014d8cac2c004ba7cadedd. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:39:24.147486 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Going to run 1 instances... {{(pid=127178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:39:24.149784 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46185d58-0d47-4c97-b590-0f4434aa5c9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:39:24.195695 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-0273c57e-541b-41ec-866b-5a8c0d97d1c0 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.684938 Sep 01 16:39:24.196359 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 345/717] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:39:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:39:24.208415 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0ef5af62-eea4-4d4d-9c7e-1d0bc7859eb6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:24.209030 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0ef5af62-eea4-4d4d-9c7e-1d0bc7859eb6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:24.265018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0ef5af62-eea4-4d4d-9c7e-1d0bc7859eb6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:24.273007 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0ef5af62-eea4-4d4d-9c7e-1d0bc7859eb6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 200 len: 1236 microversion: 2.1 time: 0.069041 Sep 01 16:39:24.273556 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 373/718] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:24 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:25.294779 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-67f8dc6b-26a2-4a0b-952d-f9e4806a03c4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:25.295955 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-67f8dc6b-26a2-4a0b-952d-f9e4806a03c4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:25.302902 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-67f8dc6b-26a2-4a0b-952d-f9e4806a03c4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:25.303381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-67f8dc6b-26a2-4a0b-952d-f9e4806a03c4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:25.303819 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-67f8dc6b-26a2-4a0b-952d-f9e4806a03c4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:25.304506 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-67f8dc6b-26a2-4a0b-952d-f9e4806a03c4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:25.304957 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-67f8dc6b-26a2-4a0b-952d-f9e4806a03c4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:25.305378 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-67f8dc6b-26a2-4a0b-952d-f9e4806a03c4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:25.367039 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-67f8dc6b-26a2-4a0b-952d-f9e4806a03c4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:25.374734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-67f8dc6b-26a2-4a0b-952d-f9e4806a03c4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 200 len: 1288 microversion: 2.1 time: 0.084430 Sep 01 16:39:25.375296 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 346/719] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:25 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 1288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:26.395993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ee3e804e-e611-43c0-af86-01034aa849e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:26.396609 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ee3e804e-e611-43c0-af86-01034aa849e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:26.404463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee3e804e-e611-43c0-af86-01034aa849e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:26.404957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee3e804e-e611-43c0-af86-01034aa849e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:26.405392 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee3e804e-e611-43c0-af86-01034aa849e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:26.406284 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee3e804e-e611-43c0-af86-01034aa849e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:26.406741 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee3e804e-e611-43c0-af86-01034aa849e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:26.407159 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee3e804e-e611-43c0-af86-01034aa849e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:26.565463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ee3e804e-e611-43c0-af86-01034aa849e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:26.574772 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ee3e804e-e611-43c0-af86-01034aa849e4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 200 len: 1361 microversion: 2.1 time: 0.183021 Sep 01 16:39:26.581645 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 374/720] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:26 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:27.259597 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-924dd9f8-b433-4e97-987b-1338ca00aa06 req-968fb20a-9a5f-45f0-aed6-5cfe9d8bdf76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e32ddc7-b8fb-420e-8a40-f3cde9dc120f", "tag": "3e0bb2c3-4cfe-4397-8e97-194bac0a5051"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:27.271147 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-924dd9f8-b433-4e97-987b-1338ca00aa06 req-968fb20a-9a5f-45f0-aed6-5cfe9d8bdf76 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:27.271699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-924dd9f8-b433-4e97-987b-1338ca00aa06 req-968fb20a-9a5f-45f0-aed6-5cfe9d8bdf76 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:27.272197 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-924dd9f8-b433-4e97-987b-1338ca00aa06 req-968fb20a-9a5f-45f0-aed6-5cfe9d8bdf76 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:27.285064 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-924dd9f8-b433-4e97-987b-1338ca00aa06 req-968fb20a-9a5f-45f0-aed6-5cfe9d8bdf76 service nova] Creating event network-changed:3e0bb2c3-4cfe-4397-8e97-194bac0a5051 for instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f on hv-cinder-85220 Sep 01 16:39:27.290092 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-924dd9f8-b433-4e97-987b-1338ca00aa06 req-968fb20a-9a5f-45f0-aed6-5cfe9d8bdf76 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203247 Sep 01 16:39:27.291067 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 347/721] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:27.596109 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-fdf97625-1256-458e-8138-14f17807a0d4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:27.596705 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-fdf97625-1256-458e-8138-14f17807a0d4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:27.603794 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fdf97625-1256-458e-8138-14f17807a0d4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:27.604782 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fdf97625-1256-458e-8138-14f17807a0d4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:27.605204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fdf97625-1256-458e-8138-14f17807a0d4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:27.605895 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fdf97625-1256-458e-8138-14f17807a0d4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:27.606366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fdf97625-1256-458e-8138-14f17807a0d4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:27.606781 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fdf97625-1256-458e-8138-14f17807a0d4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:27.739625 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-fdf97625-1256-458e-8138-14f17807a0d4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:27.747783 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-fdf97625-1256-458e-8138-14f17807a0d4 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 200 len: 1361 microversion: 2.1 time: 0.155483 Sep 01 16:39:27.748885 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 375/722] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:27 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:28.771006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-2e80fa19-519a-4073-8cee-77be4d202cd8 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:28.771704 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-2e80fa19-519a-4073-8cee-77be4d202cd8 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:28.781318 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2e80fa19-519a-4073-8cee-77be4d202cd8 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:28.784416 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2e80fa19-519a-4073-8cee-77be4d202cd8 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:28.788452 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2e80fa19-519a-4073-8cee-77be4d202cd8 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:28.789441 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2e80fa19-519a-4073-8cee-77be4d202cd8 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:28.790061 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2e80fa19-519a-4073-8cee-77be4d202cd8 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:28.790721 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2e80fa19-519a-4073-8cee-77be4d202cd8 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:29.045282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2e80fa19-519a-4073-8cee-77be4d202cd8 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:29.058355 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-2e80fa19-519a-4073-8cee-77be4d202cd8 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 200 len: 1361 microversion: 2.1 time: 0.292261 Sep 01 16:39:29.059805 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 348/723] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:28 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 1361 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:30.081027 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6652baec-9444-42f2-ad08-d0b0cad41ca1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:30.081710 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6652baec-9444-42f2-ad08-d0b0cad41ca1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:30.088751 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6652baec-9444-42f2-ad08-d0b0cad41ca1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:30.089234 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6652baec-9444-42f2-ad08-d0b0cad41ca1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:30.089657 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6652baec-9444-42f2-ad08-d0b0cad41ca1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:30.090374 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6652baec-9444-42f2-ad08-d0b0cad41ca1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:30.090821 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6652baec-9444-42f2-ad08-d0b0cad41ca1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:30.091280 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6652baec-9444-42f2-ad08-d0b0cad41ca1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:30.500841 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6652baec-9444-42f2-ad08-d0b0cad41ca1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:30.509099 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6652baec-9444-42f2-ad08-d0b0cad41ca1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 200 len: 1361 microversion: 2.1 time: 0.432499 Sep 01 16:39:30.509931 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 376/724] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:30 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 1361 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:31.530898 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f2514e41-cec6-4d33-aae5-7a24843e11f9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:31.531495 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f2514e41-cec6-4d33-aae5-7a24843e11f9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:31.538077 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f2514e41-cec6-4d33-aae5-7a24843e11f9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:31.539202 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f2514e41-cec6-4d33-aae5-7a24843e11f9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:31.539631 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f2514e41-cec6-4d33-aae5-7a24843e11f9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:31.540488 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f2514e41-cec6-4d33-aae5-7a24843e11f9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:31.541087 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f2514e41-cec6-4d33-aae5-7a24843e11f9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:31.541666 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f2514e41-cec6-4d33-aae5-7a24843e11f9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:31.706144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f2514e41-cec6-4d33-aae5-7a24843e11f9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:31.716527 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f2514e41-cec6-4d33-aae5-7a24843e11f9 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 200 len: 1361 microversion: 2.1 time: 0.189527 Sep 01 16:39:31.730932 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 349/725] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:31 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:32.530630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-65c95d2a-b921-4b31-a8c5-b8867adcfd53 req-c7c1c670-0394-497e-b975-5e6034a0735c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e32ddc7-b8fb-420e-8a40-f3cde9dc120f", "name": "network-vif-plugged", "status": "completed", "tag": "3e0bb2c3-4cfe-4397-8e97-194bac0a5051"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:32.543062 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-65c95d2a-b921-4b31-a8c5-b8867adcfd53 req-c7c1c670-0394-497e-b975-5e6034a0735c service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:32.544074 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-65c95d2a-b921-4b31-a8c5-b8867adcfd53 req-c7c1c670-0394-497e-b975-5e6034a0735c service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:32.545039 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-65c95d2a-b921-4b31-a8c5-b8867adcfd53 req-c7c1c670-0394-497e-b975-5e6034a0735c service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:32.566398 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-65c95d2a-b921-4b31-a8c5-b8867adcfd53 req-c7c1c670-0394-497e-b975-5e6034a0735c service nova] Creating event network-vif-plugged:3e0bb2c3-4cfe-4397-8e97-194bac0a5051 for instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f on hv-cinder-85220 Sep 01 16:39:32.571821 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-65c95d2a-b921-4b31-a8c5-b8867adcfd53 req-c7c1c670-0394-497e-b975-5e6034a0735c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045619 Sep 01 16:39:32.572467 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 377/726] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:39:32.737653 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7b689f74-def0-42aa-a8a2-1d1c33fcb4e1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:32.738364 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7b689f74-def0-42aa-a8a2-1d1c33fcb4e1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:32.747069 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7b689f74-def0-42aa-a8a2-1d1c33fcb4e1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:32.750317 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7b689f74-def0-42aa-a8a2-1d1c33fcb4e1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:32.750833 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7b689f74-def0-42aa-a8a2-1d1c33fcb4e1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:32.751625 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7b689f74-def0-42aa-a8a2-1d1c33fcb4e1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:32.754666 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7b689f74-def0-42aa-a8a2-1d1c33fcb4e1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:32.755300 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7b689f74-def0-42aa-a8a2-1d1c33fcb4e1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:32.994684 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-7b689f74-def0-42aa-a8a2-1d1c33fcb4e1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:33.005044 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7b689f74-def0-42aa-a8a2-1d1c33fcb4e1 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 200 len: 1361 microversion: 2.1 time: 0.271127 Sep 01 16:39:33.005641 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 350/727] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:32 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 1361 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:33.036485 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-34c2d5e7-d8c6-4ce5-bb82-96a6c3304201 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:33.037315 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-34c2d5e7-d8c6-4ce5-bb82-96a6c3304201 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:33.043626 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34c2d5e7-d8c6-4ce5-bb82-96a6c3304201 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:33.045299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34c2d5e7-d8c6-4ce5-bb82-96a6c3304201 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:33.046136 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34c2d5e7-d8c6-4ce5-bb82-96a6c3304201 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:33.047228 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34c2d5e7-d8c6-4ce5-bb82-96a6c3304201 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:33.047910 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34c2d5e7-d8c6-4ce5-bb82-96a6c3304201 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:33.048546 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34c2d5e7-d8c6-4ce5-bb82-96a6c3304201 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:33.150471 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-34c2d5e7-d8c6-4ce5-bb82-96a6c3304201 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lazy-loading 'services' on Instance uuid 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:39:33.249726 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-34c2d5e7-d8c6-4ce5-bb82-96a6c3304201 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "DELETE /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-volume_attachments/a874aaf9-7c64-4ad8-be12-ac8423450f9d" status: 202 len: 0 microversion: 2.1 time: 0.218092 Sep 01 16:39:33.251461 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 378/728] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 1 16:39:33 2022] DELETE /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-volume_attachments/a874aaf9-7c64-4ad8-be12-ac8423450f9d => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:39:33.261441 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-3a894df1-c112-409a-8be2-233dd1e56497 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:33.265192 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-3a894df1-c112-409a-8be2-233dd1e56497 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:33.282634 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3a894df1-c112-409a-8be2-233dd1e56497 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:33.283182 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3a894df1-c112-409a-8be2-233dd1e56497 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:33.283815 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3a894df1-c112-409a-8be2-233dd1e56497 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:33.286712 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3a894df1-c112-409a-8be2-233dd1e56497 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:33.287375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3a894df1-c112-409a-8be2-233dd1e56497 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:33.287965 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3a894df1-c112-409a-8be2-233dd1e56497 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:33.323871 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-3a894df1-c112-409a-8be2-233dd1e56497 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067978 Sep 01 16:39:33.324923 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 351/729] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:39:33 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:34.029773 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0ffede44-9a9f-4346-bd60-d3d1a643a03b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:34.031266 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0ffede44-9a9f-4346-bd60-d3d1a643a03b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:34.038229 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0ffede44-9a9f-4346-bd60-d3d1a643a03b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:34.039069 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0ffede44-9a9f-4346-bd60-d3d1a643a03b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:34.039652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0ffede44-9a9f-4346-bd60-d3d1a643a03b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:34.040565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0ffede44-9a9f-4346-bd60-d3d1a643a03b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:34.041277 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0ffede44-9a9f-4346-bd60-d3d1a643a03b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:34.041855 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0ffede44-9a9f-4346-bd60-d3d1a643a03b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:34.273178 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=6 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:34.280636 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0ffede44-9a9f-4346-bd60-d3d1a643a03b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:34.290636 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0ffede44-9a9f-4346-bd60-d3d1a643a03b tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 200 len: 1361 microversion: 2.1 time: 0.268790 Sep 01 16:39:34.303721 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 379/730] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:34 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 1361 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:34.337449 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ba47ee03-3233-46b5-b338-7b04281dbe65 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:34.339752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ba47ee03-3233-46b5-b338-7b04281dbe65 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:34.342501 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:34.343239 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=6 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:34.349003 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ba47ee03-3233-46b5-b338-7b04281dbe65 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:34.349489 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ba47ee03-3233-46b5-b338-7b04281dbe65 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:34.350150 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ba47ee03-3233-46b5-b338-7b04281dbe65 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:34.350878 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ba47ee03-3233-46b5-b338-7b04281dbe65 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:34.351328 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ba47ee03-3233-46b5-b338-7b04281dbe65 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:34.351744 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ba47ee03-3233-46b5-b338-7b04281dbe65 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:34.386327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ba47ee03-3233-46b5-b338-7b04281dbe65 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053136 Sep 01 16:39:34.386914 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 352/731] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:39:34 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:35.311609 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-55a6c9f5-bd19-424a-8102-ce469dddb610 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:35.312343 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-55a6c9f5-bd19-424a-8102-ce469dddb610 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:35.318738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55a6c9f5-bd19-424a-8102-ce469dddb610 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:35.319312 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55a6c9f5-bd19-424a-8102-ce469dddb610 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:35.319816 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55a6c9f5-bd19-424a-8102-ce469dddb610 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:35.320598 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55a6c9f5-bd19-424a-8102-ce469dddb610 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:35.321189 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55a6c9f5-bd19-424a-8102-ce469dddb610 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:35.321678 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55a6c9f5-bd19-424a-8102-ce469dddb610 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:35.402087 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6a8e19d1-f4aa-4b6a-b780-222ebfbacec6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:35.406022 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-6a8e19d1-f4aa-4b6a-b780-222ebfbacec6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:35.422523 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a8e19d1-f4aa-4b6a-b780-222ebfbacec6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:35.422939 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a8e19d1-f4aa-4b6a-b780-222ebfbacec6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:35.423370 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a8e19d1-f4aa-4b6a-b780-222ebfbacec6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:35.427275 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a8e19d1-f4aa-4b6a-b780-222ebfbacec6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:35.427734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a8e19d1-f4aa-4b6a-b780-222ebfbacec6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:35.428331 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6a8e19d1-f4aa-4b6a-b780-222ebfbacec6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:35.473827 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-6a8e19d1-f4aa-4b6a-b780-222ebfbacec6 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076724 Sep 01 16:39:35.480648 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 353/732] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:39:35 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:35.496942 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-55a6c9f5-bd19-424a-8102-ce469dddb610 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:35.509516 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-55a6c9f5-bd19-424a-8102-ce469dddb610 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 200 len: 1547 microversion: 2.1 time: 0.201682 Sep 01 16:39:35.512624 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 380/733] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:35 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 1547 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:35.535432 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-59da9b9e-ce85-43d9-ad96-981553885581 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:35.536417 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-59da9b9e-ce85-43d9-ad96-981553885581 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:35.554732 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59da9b9e-ce85-43d9-ad96-981553885581 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:35.555228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59da9b9e-ce85-43d9-ad96-981553885581 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:35.555667 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59da9b9e-ce85-43d9-ad96-981553885581 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:35.556400 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59da9b9e-ce85-43d9-ad96-981553885581 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:35.556859 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59da9b9e-ce85-43d9-ad96-981553885581 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:35.557463 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-59da9b9e-ce85-43d9-ad96-981553885581 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:35.660328 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-59da9b9e-ce85-43d9-ad96-981553885581 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131553 Sep 01 16:39:35.660927 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 354/734] 10.222.0.18 () {58 vars in 1275 bytes} [Thu Sep 1 16:39:35 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:36.487496 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3633ba90-d5d8-4e6d-b97a-02ca9d013436 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:36.489773 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3633ba90-d5d8-4e6d-b97a-02ca9d013436 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:36.505278 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3633ba90-d5d8-4e6d-b97a-02ca9d013436 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:36.506115 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3633ba90-d5d8-4e6d-b97a-02ca9d013436 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:36.506941 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3633ba90-d5d8-4e6d-b97a-02ca9d013436 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:36.507865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3633ba90-d5d8-4e6d-b97a-02ca9d013436 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:36.509621 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3633ba90-d5d8-4e6d-b97a-02ca9d013436 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:36.511574 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3633ba90-d5d8-4e6d-b97a-02ca9d013436 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:36.601216 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3633ba90-d5d8-4e6d-b97a-02ca9d013436 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.118727 Sep 01 16:39:36.603341 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 381/735] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:39:36 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:39:36.753539 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-bd9eb658-aee0-476a-bdf3-51e87e5d9435 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:36.754422 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-bd9eb658-aee0-476a-bdf3-51e87e5d9435 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:36.786942 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bd9eb658-aee0-476a-bdf3-51e87e5d9435 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:36.789033 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bd9eb658-aee0-476a-bdf3-51e87e5d9435 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:36.790824 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bd9eb658-aee0-476a-bdf3-51e87e5d9435 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:36.798087 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bd9eb658-aee0-476a-bdf3-51e87e5d9435 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:36.804803 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bd9eb658-aee0-476a-bdf3-51e87e5d9435 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:36.805894 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bd9eb658-aee0-476a-bdf3-51e87e5d9435 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:36.880123 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-bd9eb658-aee0-476a-bdf3-51e87e5d9435 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Going to try to terminate instance {{(pid=127178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:39:37.065623 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-bd9eb658-aee0-476a-bdf3-51e87e5d9435 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "DELETE /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 204 len: 0 microversion: 2.1 time: 0.318717 Sep 01 16:39:37.066798 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 355/736] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:39:36 2022] DELETE /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:39:37.075086 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-74e6d931-0f93-435b-8a5b-99415fb3ce36 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:37.076653 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-74e6d931-0f93-435b-8a5b-99415fb3ce36 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:37.088724 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-74e6d931-0f93-435b-8a5b-99415fb3ce36 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:37.093486 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-74e6d931-0f93-435b-8a5b-99415fb3ce36 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:37.094110 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-74e6d931-0f93-435b-8a5b-99415fb3ce36 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:37.095024 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-74e6d931-0f93-435b-8a5b-99415fb3ce36 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:37.095611 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-74e6d931-0f93-435b-8a5b-99415fb3ce36 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:37.096544 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-74e6d931-0f93-435b-8a5b-99415fb3ce36 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:37.531048 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-74e6d931-0f93-435b-8a5b-99415fb3ce36 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:37.540560 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-74e6d931-0f93-435b-8a5b-99415fb3ce36 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1687 microversion: 2.1 time: 0.469549 Sep 01 16:39:37.551500 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 382/737] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:37 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1687 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:37.905458 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-d7c5519a-b8c9-4bf4-aa6f-81d8b14177cc req-ddac1bee-5f31-4fce-b5ec-597bac9fd600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e32ddc7-b8fb-420e-8a40-f3cde9dc120f", "tag": "3e0bb2c3-4cfe-4397-8e97-194bac0a5051"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:37.917975 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-d7c5519a-b8c9-4bf4-aa6f-81d8b14177cc req-ddac1bee-5f31-4fce-b5ec-597bac9fd600 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:37.918900 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-d7c5519a-b8c9-4bf4-aa6f-81d8b14177cc req-ddac1bee-5f31-4fce-b5ec-597bac9fd600 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:37.919989 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-d7c5519a-b8c9-4bf4-aa6f-81d8b14177cc req-ddac1bee-5f31-4fce-b5ec-597bac9fd600 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:37.935142 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-d7c5519a-b8c9-4bf4-aa6f-81d8b14177cc req-ddac1bee-5f31-4fce-b5ec-597bac9fd600 service nova] Creating event network-changed:3e0bb2c3-4cfe-4397-8e97-194bac0a5051 for instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f on hv-cinder-85220 Sep 01 16:39:37.944555 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-d7c5519a-b8c9-4bf4-aa6f-81d8b14177cc req-ddac1bee-5f31-4fce-b5ec-597bac9fd600 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043340 Sep 01 16:39:37.945256 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 356/738] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:38.569816 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-fd966b69-744a-4466-bf46-239e822b3342 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:38.571004 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-fd966b69-744a-4466-bf46-239e822b3342 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:38.580816 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fd966b69-744a-4466-bf46-239e822b3342 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:38.581555 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fd966b69-744a-4466-bf46-239e822b3342 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:38.582268 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fd966b69-744a-4466-bf46-239e822b3342 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:38.583430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fd966b69-744a-4466-bf46-239e822b3342 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:38.584164 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fd966b69-744a-4466-bf46-239e822b3342 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:38.584805 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-fd966b69-744a-4466-bf46-239e822b3342 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:38.759722 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-fd966b69-744a-4466-bf46-239e822b3342 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:38.770892 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-fd966b69-744a-4466-bf46-239e822b3342 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1687 microversion: 2.1 time: 0.205625 Sep 01 16:39:38.772371 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 357/739] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:38 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1687 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:38.843125 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cee59d75-a9f2-45e9-8f96-d131c6b8a6c0 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Action: 'create', calling method: .version_select at 0x7feeec081ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-343666896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHC53MDTu+eIoFnPjwE9igUh45FQeRA+wqYwHK6852hJiTS6Bz/D2L1ouaJhq9BxQo+RjrhJcIygyQE8SdkvOuG8wjgFfYcImrt+e2Xmszy3n2UrpyS8vgfywueUdMFsvw=="}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:38.860472 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-cee59d75-a9f2-45e9-8f96-d131c6b8a6c0 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Getting quotas for project b683a11c21fe4dd389a006f051576a1b. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:39:38.864574 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-cee59d75-a9f2-45e9-8f96-d131c6b8a6c0 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Getting quotas for user aa6ad9c2c1294633a74782c668227886 and project b683a11c21fe4dd389a006f051576a1b. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:39:38.889911 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cee59d75-a9f2-45e9-8f96-d131c6b8a6c0 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.370153 Sep 01 16:39:38.890685 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 383/740] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 1 16:39:38 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:39:39.793412 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ebc03832-02c2-488c-a58b-70d318c591cc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:39.795204 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ebc03832-02c2-488c-a58b-70d318c591cc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:39.802802 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ebc03832-02c2-488c-a58b-70d318c591cc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:39.804451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ebc03832-02c2-488c-a58b-70d318c591cc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:39.805074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ebc03832-02c2-488c-a58b-70d318c591cc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:39.806075 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ebc03832-02c2-488c-a58b-70d318c591cc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:39.806865 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ebc03832-02c2-488c-a58b-70d318c591cc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:39.807499 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ebc03832-02c2-488c-a58b-70d318c591cc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:39.948207 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ebc03832-02c2-488c-a58b-70d318c591cc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:39.956617 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ebc03832-02c2-488c-a58b-70d318c591cc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1687 microversion: 2.1 time: 0.167370 Sep 01 16:39:39.957967 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 358/741] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:39 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:40.979025 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0ee1996a-c551-429b-9dcb-44c01eb399be tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:40.980293 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0ee1996a-c551-429b-9dcb-44c01eb399be tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:40.988059 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0ee1996a-c551-429b-9dcb-44c01eb399be tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:40.988821 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0ee1996a-c551-429b-9dcb-44c01eb399be tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:40.989418 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0ee1996a-c551-429b-9dcb-44c01eb399be tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:40.990401 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0ee1996a-c551-429b-9dcb-44c01eb399be tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:40.990854 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0ee1996a-c551-429b-9dcb-44c01eb399be tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:40.991273 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0ee1996a-c551-429b-9dcb-44c01eb399be tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:41.143681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0ee1996a-c551-429b-9dcb-44c01eb399be tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:41.152349 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0ee1996a-c551-429b-9dcb-44c01eb399be tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1687 microversion: 2.1 time: 0.177790 Sep 01 16:39:41.154048 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 384/742] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:40 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:42.019594 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-1cd7661a-f17f-487d-95d9-7d4c9a90498d req-b2df7236-a40f-4b6e-8716-074b7c9212ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f1e8ce-fea9-426e-8ce0-23b9f7851b4e", "name": "network-vif-deleted", "tag": "2b174a59-f0a9-4b1a-9233-ea65d28a5d38"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:42.030141 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-1cd7661a-f17f-487d-95d9-7d4c9a90498d req-b2df7236-a40f-4b6e-8716-074b7c9212ed service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:42.030642 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-1cd7661a-f17f-487d-95d9-7d4c9a90498d req-b2df7236-a40f-4b6e-8716-074b7c9212ed service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:42.031416 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-1cd7661a-f17f-487d-95d9-7d4c9a90498d req-b2df7236-a40f-4b6e-8716-074b7c9212ed service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:42.051143 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-1cd7661a-f17f-487d-95d9-7d4c9a90498d req-b2df7236-a40f-4b6e-8716-074b7c9212ed service nova] Creating event network-vif-deleted:2b174a59-f0a9-4b1a-9233-ea65d28a5d38 for instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e on hv-cinder-85220 Sep 01 16:39:42.057012 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-1cd7661a-f17f-487d-95d9-7d4c9a90498d req-b2df7236-a40f-4b6e-8716-074b7c9212ed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040931 Sep 01 16:39:42.057668 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 359/743] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:42.175470 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f7af7340-47eb-4b7e-ad94-68eac4a74052 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:42.176250 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f7af7340-47eb-4b7e-ad94-68eac4a74052 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:42.183121 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7af7340-47eb-4b7e-ad94-68eac4a74052 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:42.183752 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7af7340-47eb-4b7e-ad94-68eac4a74052 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:42.184647 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7af7340-47eb-4b7e-ad94-68eac4a74052 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:42.186487 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7af7340-47eb-4b7e-ad94-68eac4a74052 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:42.187397 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7af7340-47eb-4b7e-ad94-68eac4a74052 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:42.188054 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7af7340-47eb-4b7e-ad94-68eac4a74052 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:42.228888 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7af7340-47eb-4b7e-ad94-68eac4a74052 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:42.229386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7af7340-47eb-4b7e-ad94-68eac4a74052 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:42.230788 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f7af7340-47eb-4b7e-ad94-68eac4a74052 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:42.231433 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-f7af7340-47eb-4b7e-ad94-68eac4a74052 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lazy-loading 'fault' on Instance uuid 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:39:42.279558 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f7af7340-47eb-4b7e-ad94-68eac4a74052 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:42.290278 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f7af7340-47eb-4b7e-ad94-68eac4a74052 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 200 len: 1334 microversion: 2.1 time: 0.119219 Sep 01 16:39:42.290987 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 385/744] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:42 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 1334 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:43.313022 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-584cc22c-5254-4c58-8c3a-18449830b6c7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:43.313827 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-584cc22c-5254-4c58-8c3a-18449830b6c7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:43.316111 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:43.327936 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-584cc22c-5254-4c58-8c3a-18449830b6c7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:43.328568 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-584cc22c-5254-4c58-8c3a-18449830b6c7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:43.329073 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-584cc22c-5254-4c58-8c3a-18449830b6c7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:43.329881 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-584cc22c-5254-4c58-8c3a-18449830b6c7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:43.330462 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-584cc22c-5254-4c58-8c3a-18449830b6c7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:43.331203 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-584cc22c-5254-4c58-8c3a-18449830b6c7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:43.347871 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-584cc22c-5254-4c58-8c3a-18449830b6c7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] HTTP exception thrown: Instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e could not be found. Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-584cc22c-5254-4c58-8c3a-18449830b6c7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Request method failure captured: Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e HTTP/1.1 Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN8F17LXR9QZKG1_VIEG9-p8CRv4W7TM6E6dScWkaJQxBYZmnEi3ulzPAVr0-b20dizp00dSNiiSfWFSUTO8kWHVwi7TysP99jGN0Cq7VR3f5DEHM8MBqhsccbwVjs5uyEAzYbVKihge-cMSlpBXs8gzVRuYafB1F18mDaUBDx4zRr4 Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: b4bbb5d3895c49fa8695d3bca946dbea Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1309500920 Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:39:43.349963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:39:43.351964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:39:43.351964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1309500920 Sep 01 16:39:43.351964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: b4bbb5d3895c49fa8695d3bca946dbea Sep 01 16:39:43.351964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1309500920 Sep 01 16:39:43.351964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-ServerRescueNegativeTestJSON-1309500920-project Sep 01 16:39:43.351964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:39:43.351964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:39:43.351964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: 8020db56bca04d61b5a6e40384c25715 Sep 01 16:39:43.351964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1309500920-project Sep 01 16:39:43.351964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:39:43.351964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e could not be found. Sep 01 16:39:43.351964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': '21f1e8ce-fea9-426e-8ce0-23b9f7851b4e'} Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e could not be found. Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:39:43.352896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e could not be found. Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e could not be found. Sep 01 16:39:43.354563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:39:43.357908 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-584cc22c-5254-4c58-8c3a-18449830b6c7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Returning 404 to user: Instance 21f1e8ce-fea9-426e-8ce0-23b9f7851b4e could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:39:43.359010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-584cc22c-5254-4c58-8c3a-18449830b6c7 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e" status: 404 len: 111 microversion: 2.1 time: 0.051272 Sep 01 16:39:43.360081 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 360/745] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:43 2022] GET /compute/v2.1/servers/21f1e8ce-fea9-426e-8ce0-23b9f7851b4e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:39:43.368394 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5658bfa1-e7c2-40bf-924d-594b40ef4bad tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '.version_select at 0x7feeec1c5430>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:43.389927 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5658bfa1-e7c2-40bf-924d-594b40ef4bad tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-165001982" status: 202 len: 0 microversion: 2.1 time: 0.025789 Sep 01 16:39:43.390559 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 386/746] 10.222.0.18 () {58 vars in 1218 bytes} [Thu Sep 1 16:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-165001982 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:39:46.339940 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-454f4f4a-9df8-4631-b8ac-3fa26ec01901 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:46.340469 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-454f4f4a-9df8-4631-b8ac-3fa26ec01901 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:46.347783 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-454f4f4a-9df8-4631-b8ac-3fa26ec01901 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:46.348533 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-454f4f4a-9df8-4631-b8ac-3fa26ec01901 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:46.348967 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-454f4f4a-9df8-4631-b8ac-3fa26ec01901 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:46.349660 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-454f4f4a-9df8-4631-b8ac-3fa26ec01901 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:46.350111 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-454f4f4a-9df8-4631-b8ac-3fa26ec01901 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:46.350575 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-454f4f4a-9df8-4631-b8ac-3fa26ec01901 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:46.367630 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:46.380425 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-454f4f4a-9df8-4631-b8ac-3fa26ec01901 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Going to try to terminate instance {{(pid=127178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:39:46.466755 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-454f4f4a-9df8-4631-b8ac-3fa26ec01901 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 204 len: 0 microversion: 2.1 time: 0.129850 Sep 01 16:39:46.467600 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 361/747] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:39:46 2022] DELETE /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:39:46.476261 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4fa08740-d8eb-420d-8ec3-9aad228a1bf5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:46.476899 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4fa08740-d8eb-420d-8ec3-9aad228a1bf5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:46.483268 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fa08740-d8eb-420d-8ec3-9aad228a1bf5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:46.483751 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fa08740-d8eb-420d-8ec3-9aad228a1bf5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:46.484183 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fa08740-d8eb-420d-8ec3-9aad228a1bf5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:46.485008 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fa08740-d8eb-420d-8ec3-9aad228a1bf5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:46.485469 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fa08740-d8eb-420d-8ec3-9aad228a1bf5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:46.485896 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fa08740-d8eb-420d-8ec3-9aad228a1bf5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:46.632898 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4fa08740-d8eb-420d-8ec3-9aad228a1bf5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:46.642333 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4fa08740-d8eb-420d-8ec3-9aad228a1bf5 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1506 microversion: 2.1 time: 0.170588 Sep 01 16:39:46.643200 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 387/748] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:46 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:47.667024 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c29ac620-6c9e-46cb-a75d-f821cc8fdfdc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:47.667896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c29ac620-6c9e-46cb-a75d-f821cc8fdfdc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:47.675238 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c29ac620-6c9e-46cb-a75d-f821cc8fdfdc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:47.675730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c29ac620-6c9e-46cb-a75d-f821cc8fdfdc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:47.676163 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c29ac620-6c9e-46cb-a75d-f821cc8fdfdc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:47.676860 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c29ac620-6c9e-46cb-a75d-f821cc8fdfdc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:47.677310 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c29ac620-6c9e-46cb-a75d-f821cc8fdfdc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:47.677915 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c29ac620-6c9e-46cb-a75d-f821cc8fdfdc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:47.817913 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c29ac620-6c9e-46cb-a75d-f821cc8fdfdc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:47.830272 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c29ac620-6c9e-46cb-a75d-f821cc8fdfdc tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1506 microversion: 2.1 time: 0.167144 Sep 01 16:39:47.830855 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 362/749] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:47 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:48.624181 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-10bfa012-051d-44e1-9379-d1275fb91bcc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:48.624677 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-10bfa012-051d-44e1-9379-d1275fb91bcc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:48.631009 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10bfa012-051d-44e1-9379-d1275fb91bcc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:48.631615 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10bfa012-051d-44e1-9379-d1275fb91bcc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:48.632230 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10bfa012-051d-44e1-9379-d1275fb91bcc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:48.633113 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10bfa012-051d-44e1-9379-d1275fb91bcc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:48.633684 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10bfa012-051d-44e1-9379-d1275fb91bcc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:48.634313 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10bfa012-051d-44e1-9379-d1275fb91bcc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:48.659175 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-10bfa012-051d-44e1-9379-d1275fb91bcc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293/ips" status: 200 len: 152 microversion: 2.20 time: 0.143596 Sep 01 16:39:48.659722 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 388/750] 10.222.0.18 () {60 vars in 1289 bytes} [Thu Sep 1 16:39:48 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293/ips => generated 152 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:39:48.851198 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d4fae3b7-5010-4050-bfad-104e731a2832 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:48.852103 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d4fae3b7-5010-4050-bfad-104e731a2832 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:48.859355 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4fae3b7-5010-4050-bfad-104e731a2832 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:48.859843 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4fae3b7-5010-4050-bfad-104e731a2832 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:48.860279 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4fae3b7-5010-4050-bfad-104e731a2832 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:48.861058 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4fae3b7-5010-4050-bfad-104e731a2832 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:48.861728 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4fae3b7-5010-4050-bfad-104e731a2832 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:48.862229 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4fae3b7-5010-4050-bfad-104e731a2832 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:49.047965 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d4fae3b7-5010-4050-bfad-104e731a2832 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:49.055941 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d4fae3b7-5010-4050-bfad-104e731a2832 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1506 microversion: 2.1 time: 0.208982 Sep 01 16:39:49.056509 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 363/751] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:48 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:49.761152 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-9013517e-1ea3-42de-b230-98554a7e87b0 req-c4c96e8e-b2b2-4c17-a398-43488610b76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fae886be-6615-48f8-8482-9f04376a3dd3", "name": "network-vif-deleted", "tag": "1a82e99d-ba3e-4063-bdf7-4d47fa07f110"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:49.770269 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=4 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:49.783378 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-9013517e-1ea3-42de-b230-98554a7e87b0 req-c4c96e8e-b2b2-4c17-a398-43488610b76b service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:49.784198 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-9013517e-1ea3-42de-b230-98554a7e87b0 req-c4c96e8e-b2b2-4c17-a398-43488610b76b service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:49.784773 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-9013517e-1ea3-42de-b230-98554a7e87b0 req-c4c96e8e-b2b2-4c17-a398-43488610b76b service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:49.801924 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:49.806488 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-9013517e-1ea3-42de-b230-98554a7e87b0 req-c4c96e8e-b2b2-4c17-a398-43488610b76b service nova] Creating event network-vif-deleted:1a82e99d-ba3e-4063-bdf7-4d47fa07f110 for instance fae886be-6615-48f8-8482-9f04376a3dd3 on hv-cinder-85220 Sep 01 16:39:49.816376 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-9013517e-1ea3-42de-b230-98554a7e87b0 req-c4c96e8e-b2b2-4c17-a398-43488610b76b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065518 Sep 01 16:39:49.817450 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 389/752] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:50.078678 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-8fc192db-7656-418b-828d-a28a8ce5d180 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:50.079642 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-8fc192db-7656-418b-828d-a28a8ce5d180 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:50.087854 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8fc192db-7656-418b-828d-a28a8ce5d180 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:50.088554 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8fc192db-7656-418b-828d-a28a8ce5d180 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:50.089059 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8fc192db-7656-418b-828d-a28a8ce5d180 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:50.089870 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8fc192db-7656-418b-828d-a28a8ce5d180 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:50.091554 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8fc192db-7656-418b-828d-a28a8ce5d180 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:50.092171 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8fc192db-7656-418b-828d-a28a8ce5d180 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:50.135397 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8fc192db-7656-418b-828d-a28a8ce5d180 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:50.136052 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8fc192db-7656-418b-828d-a28a8ce5d180 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:50.136586 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8fc192db-7656-418b-828d-a28a8ce5d180 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:50.137195 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.objects.instance [None req-8fc192db-7656-418b-828d-a28a8ce5d180 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lazy-loading 'fault' on Instance uuid fae886be-6615-48f8-8482-9f04376a3dd3 {{(pid=127178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:39:50.205284 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-8fc192db-7656-418b-828d-a28a8ce5d180 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:50.218664 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-8fc192db-7656-418b-828d-a28a8ce5d180 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 200 len: 1312 microversion: 2.1 time: 0.145105 Sep 01 16:39:50.219630 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 364/753] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:50 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 1312 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:50.909298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-76deb4d8-f7a9-45a4-82d4-f34bbb9822c9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:50.909921 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-76deb4d8-f7a9-45a4-82d4-f34bbb9822c9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:50.916327 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-76deb4d8-f7a9-45a4-82d4-f34bbb9822c9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:50.916859 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-76deb4d8-f7a9-45a4-82d4-f34bbb9822c9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:50.917292 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-76deb4d8-f7a9-45a4-82d4-f34bbb9822c9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:50.917979 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-76deb4d8-f7a9-45a4-82d4-f34bbb9822c9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:50.918454 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-76deb4d8-f7a9-45a4-82d4-f34bbb9822c9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:50.919493 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-76deb4d8-f7a9-45a4-82d4-f34bbb9822c9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:50.943458 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-76deb4d8-f7a9-45a4-82d4-f34bbb9822c9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lazy-loading 'flavor' on Instance uuid 7d764e51-5b8a-4d17-886e-b52189448293 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:39:51.126695 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-76deb4d8-f7a9-45a4-82d4-f34bbb9822c9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "POST /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293/action" status: 202 len: 0 microversion: 2.20 time: 0.223097 Sep 01 16:39:51.127287 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 390/754] 10.222.0.18 () {62 vars in 1319 bytes} [Thu Sep 1 16:39:50 2022] POST /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:39:51.135749 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-25849f3e-e342-4c31-aaea-fa04840f7c43 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:51.136356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-25849f3e-e342-4c31-aaea-fa04840f7c43 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:51.143282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-25849f3e-e342-4c31-aaea-fa04840f7c43 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:51.143764 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-25849f3e-e342-4c31-aaea-fa04840f7c43 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:51.144231 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-25849f3e-e342-4c31-aaea-fa04840f7c43 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:51.145016 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-25849f3e-e342-4c31-aaea-fa04840f7c43 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:51.145529 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-25849f3e-e342-4c31-aaea-fa04840f7c43 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:51.145975 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-25849f3e-e342-4c31-aaea-fa04840f7c43 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:51.241991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9f3eb6aa-c8b0-463b-814b-8bb61cbed967 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:51.242732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9f3eb6aa-c8b0-463b-814b-8bb61cbed967 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: fae886be-6615-48f8-8482-9f04376a3dd3] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:51.249226 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9f3eb6aa-c8b0-463b-814b-8bb61cbed967 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:51.249807 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9f3eb6aa-c8b0-463b-814b-8bb61cbed967 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:51.250267 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9f3eb6aa-c8b0-463b-814b-8bb61cbed967 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:51.250951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9f3eb6aa-c8b0-463b-814b-8bb61cbed967 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:51.251392 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9f3eb6aa-c8b0-463b-814b-8bb61cbed967 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:51.251847 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9f3eb6aa-c8b0-463b-814b-8bb61cbed967 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:51.268459 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-9f3eb6aa-c8b0-463b-814b-8bb61cbed967 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] HTTP exception thrown: Instance fae886be-6615-48f8-8482-9f04376a3dd3 could not be found. Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9f3eb6aa-c8b0-463b-814b-8bb61cbed967 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Request method failure captured: Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 HTTP/1.1 Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN8F17LXR9QZKG1_VIEG9-p8CRv4W7TM6E6dScWkaJQxBYZmnEi3ulzPAVr0-b20dizp00dSNiiSfWFSUTO8kWHVwi7TysP99jGN0Cq7VR3f5DEHM8MBqhsccbwVjs5uyEAzYbVKihge-cMSlpBXs8gzVRuYafB1F18mDaUBDx4zRr4 Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: b4bbb5d3895c49fa8695d3bca946dbea Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1309500920 Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:39:51.271212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:39:51.272759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:39:51.272759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1309500920 Sep 01 16:39:51.272759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: b4bbb5d3895c49fa8695d3bca946dbea Sep 01 16:39:51.272759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1309500920 Sep 01 16:39:51.272759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-ServerRescueNegativeTestJSON-1309500920-project Sep 01 16:39:51.272759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:39:51.272759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:39:51.272759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: 8020db56bca04d61b5a6e40384c25715 Sep 01 16:39:51.272759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1309500920-project Sep 01 16:39:51.272759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:39:51.272759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance fae886be-6615-48f8-8482-9f04376a3dd3 could not be found. Sep 01 16:39:51.272759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': 'fae886be-6615-48f8-8482-9f04376a3dd3'} Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fae886be-6615-48f8-8482-9f04376a3dd3 could not be found. Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:39:51.273586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fae886be-6615-48f8-8482-9f04376a3dd3 could not be found. Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fae886be-6615-48f8-8482-9f04376a3dd3 could not be found. Sep 01 16:39:51.274991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:39:51.277080 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9f3eb6aa-c8b0-463b-814b-8bb61cbed967 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Returning 404 to user: Instance fae886be-6615-48f8-8482-9f04376a3dd3 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:39:51.277974 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9f3eb6aa-c8b0-463b-814b-8bb61cbed967 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3" status: 404 len: 111 microversion: 2.1 time: 0.040595 Sep 01 16:39:51.279147 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 391/755] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:51 2022] GET /compute/v2.1/servers/fae886be-6615-48f8-8482-9f04376a3dd3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:39:51.297120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-25849f3e-e342-4c31-aaea-fa04840f7c43 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:51.297798 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-43049901-b1a0-47eb-a3fb-97b646bb2227 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:51.298461 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-43049901-b1a0-47eb-a3fb-97b646bb2227 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:51.306632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43049901-b1a0-47eb-a3fb-97b646bb2227 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:51.307234 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43049901-b1a0-47eb-a3fb-97b646bb2227 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:51.307953 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43049901-b1a0-47eb-a3fb-97b646bb2227 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:51.308813 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43049901-b1a0-47eb-a3fb-97b646bb2227 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:51.309081 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-25849f3e-e342-4c31-aaea-fa04840f7c43 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:51.309398 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43049901-b1a0-47eb-a3fb-97b646bb2227 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:51.309911 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43049901-b1a0-47eb-a3fb-97b646bb2227 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:51.310612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-25849f3e-e342-4c31-aaea-fa04840f7c43 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:51.311943 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-25849f3e-e342-4c31-aaea-fa04840f7c43 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1724 microversion: 2.20 time: 0.180027 Sep 01 16:39:51.312499 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 365/756] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:51 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:39:51.337891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-43049901-b1a0-47eb-a3fb-97b646bb2227 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:39:51.424768 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-43049901-b1a0-47eb-a3fb-97b646bb2227 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "DELETE /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 204 len: 0 microversion: 2.1 time: 0.131680 Sep 01 16:39:51.425497 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 392/757] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:39:51 2022] DELETE /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:39:51.434030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a0a4f5aa-bae3-4ab8-b2a6-14456352f620 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:51.434664 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a0a4f5aa-bae3-4ab8-b2a6-14456352f620 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:51.441181 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a0a4f5aa-bae3-4ab8-b2a6-14456352f620 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:51.441659 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a0a4f5aa-bae3-4ab8-b2a6-14456352f620 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:51.442181 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a0a4f5aa-bae3-4ab8-b2a6-14456352f620 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:51.443095 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a0a4f5aa-bae3-4ab8-b2a6-14456352f620 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:51.443543 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a0a4f5aa-bae3-4ab8-b2a6-14456352f620 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:51.443960 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a0a4f5aa-bae3-4ab8-b2a6-14456352f620 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:51.578782 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a0a4f5aa-bae3-4ab8-b2a6-14456352f620 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:51.586638 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a0a4f5aa-bae3-4ab8-b2a6-14456352f620 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.156385 Sep 01 16:39:51.587197 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 366/758] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:51 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:52.335915 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-fd68f2df-1714-428c-901d-e80cbee8e8c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:52.336614 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-fd68f2df-1714-428c-901d-e80cbee8e8c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:52.339041 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:52.344946 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fd68f2df-1714-428c-901d-e80cbee8e8c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:52.345422 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fd68f2df-1714-428c-901d-e80cbee8e8c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:52.345839 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fd68f2df-1714-428c-901d-e80cbee8e8c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:52.346561 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fd68f2df-1714-428c-901d-e80cbee8e8c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:52.347010 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fd68f2df-1714-428c-901d-e80cbee8e8c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:52.347411 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fd68f2df-1714-428c-901d-e80cbee8e8c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:52.493084 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-fd68f2df-1714-428c-901d-e80cbee8e8c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:52.501250 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-fd68f2df-1714-428c-901d-e80cbee8e8c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:52.502706 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-fd68f2df-1714-428c-901d-e80cbee8e8c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:52.503854 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-fd68f2df-1714-428c-901d-e80cbee8e8c5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1724 microversion: 2.20 time: 0.172215 Sep 01 16:39:52.504435 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 393/759] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:52 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:52.608349 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-8e08776b-1a09-421e-9159-87573446a645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:52.608944 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-8e08776b-1a09-421e-9159-87573446a645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:52.615405 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8e08776b-1a09-421e-9159-87573446a645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:52.615881 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8e08776b-1a09-421e-9159-87573446a645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:52.616307 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8e08776b-1a09-421e-9159-87573446a645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:52.616989 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8e08776b-1a09-421e-9159-87573446a645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:52.617431 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8e08776b-1a09-421e-9159-87573446a645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:52.617844 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8e08776b-1a09-421e-9159-87573446a645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:52.748811 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-8e08776b-1a09-421e-9159-87573446a645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:52.756652 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-8e08776b-1a09-421e-9159-87573446a645 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.152599 Sep 01 16:39:52.757144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 367/760] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:52 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:53.413576 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4096815b-4948-461b-a8d0-7be0e723d3d1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:53.414097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4096815b-4948-461b-a8d0-7be0e723d3d1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:53.421073 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4096815b-4948-461b-a8d0-7be0e723d3d1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:53.421591 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4096815b-4948-461b-a8d0-7be0e723d3d1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:53.422019 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4096815b-4948-461b-a8d0-7be0e723d3d1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:53.422741 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4096815b-4948-461b-a8d0-7be0e723d3d1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:53.423191 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4096815b-4948-461b-a8d0-7be0e723d3d1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:53.423614 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4096815b-4948-461b-a8d0-7be0e723d3d1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:53.450691 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4096815b-4948-461b-a8d0-7be0e723d3d1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:39:53.525238 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4096815b-4948-461b-a8d0-7be0e723d3d1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 204 len: 0 microversion: 2.1 time: 0.115244 Sep 01 16:39:53.525813 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 394/761] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:39:53 2022] DELETE /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:39:53.530159 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-04106a86-0333-4e56-bc80-09a601211bea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:53.531197 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-04106a86-0333-4e56-bc80-09a601211bea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:53.535632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-373d295d-00e1-497c-b7da-e55cb98ffa20 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:53.536320 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-373d295d-00e1-497c-b7da-e55cb98ffa20 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:53.538060 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04106a86-0333-4e56-bc80-09a601211bea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:53.538660 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04106a86-0333-4e56-bc80-09a601211bea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:53.539166 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04106a86-0333-4e56-bc80-09a601211bea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:53.540052 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04106a86-0333-4e56-bc80-09a601211bea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:53.540618 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04106a86-0333-4e56-bc80-09a601211bea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:53.541237 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-04106a86-0333-4e56-bc80-09a601211bea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:53.542514 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-373d295d-00e1-497c-b7da-e55cb98ffa20 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:53.542994 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-373d295d-00e1-497c-b7da-e55cb98ffa20 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:53.543426 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-373d295d-00e1-497c-b7da-e55cb98ffa20 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:53.544600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-373d295d-00e1-497c-b7da-e55cb98ffa20 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:53.545046 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-373d295d-00e1-497c-b7da-e55cb98ffa20 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:53.545463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-373d295d-00e1-497c-b7da-e55cb98ffa20 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:53.706864 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-04106a86-0333-4e56-bc80-09a601211bea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:53.708294 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-373d295d-00e1-497c-b7da-e55cb98ffa20 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:53.718556 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-373d295d-00e1-497c-b7da-e55cb98ffa20 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1576 microversion: 2.1 time: 0.186876 Sep 01 16:39:53.719142 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 395/762] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:53 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:53.721064 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-04106a86-0333-4e56-bc80-09a601211bea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:53.722914 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-04106a86-0333-4e56-bc80-09a601211bea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:53.724550 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-04106a86-0333-4e56-bc80-09a601211bea tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1724 microversion: 2.20 time: 0.201226 Sep 01 16:39:53.725213 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 368/763] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:53 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:53.780641 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-28fcd16c-e93a-453f-98e4-74463fec1b6e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:53.781235 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-28fcd16c-e93a-453f-98e4-74463fec1b6e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:53.787233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-28fcd16c-e93a-453f-98e4-74463fec1b6e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:53.787711 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-28fcd16c-e93a-453f-98e4-74463fec1b6e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:53.788123 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-28fcd16c-e93a-453f-98e4-74463fec1b6e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:53.788813 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-28fcd16c-e93a-453f-98e4-74463fec1b6e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:53.789250 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-28fcd16c-e93a-453f-98e4-74463fec1b6e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:53.789662 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-28fcd16c-e93a-453f-98e4-74463fec1b6e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:54.132545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-28fcd16c-e93a-453f-98e4-74463fec1b6e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:54.140799 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-28fcd16c-e93a-453f-98e4-74463fec1b6e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.364533 Sep 01 16:39:54.141611 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 396/764] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:53 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:54.742895 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a87766cc-688e-4888-b092-a9e6c024b3c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:54.744189 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a87766cc-688e-4888-b092-a9e6c024b3c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:54.751571 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a87766cc-688e-4888-b092-a9e6c024b3c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:54.752300 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a87766cc-688e-4888-b092-a9e6c024b3c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:54.752924 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a87766cc-688e-4888-b092-a9e6c024b3c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:54.753283 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dfe98516-26ac-466a-a99d-c00f5acb05a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:54.754056 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a87766cc-688e-4888-b092-a9e6c024b3c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:54.754282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a87766cc-688e-4888-b092-a9e6c024b3c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:54.754467 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-dfe98516-26ac-466a-a99d-c00f5acb05a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:54.754808 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a87766cc-688e-4888-b092-a9e6c024b3c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:54.770863 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfe98516-26ac-466a-a99d-c00f5acb05a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:54.771925 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfe98516-26ac-466a-a99d-c00f5acb05a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:54.772627 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfe98516-26ac-466a-a99d-c00f5acb05a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:54.774072 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfe98516-26ac-466a-a99d-c00f5acb05a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:54.774886 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfe98516-26ac-466a-a99d-c00f5acb05a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:54.775659 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfe98516-26ac-466a-a99d-c00f5acb05a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:54.920012 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a87766cc-688e-4888-b092-a9e6c024b3c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:54.927890 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a87766cc-688e-4888-b092-a9e6c024b3c3 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1576 microversion: 2.1 time: 0.190324 Sep 01 16:39:54.928463 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 369/765] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:54 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:54.936459 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dfe98516-26ac-466a-a99d-c00f5acb05a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:54.944761 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dfe98516-26ac-466a-a99d-c00f5acb05a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:54.946193 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dfe98516-26ac-466a-a99d-c00f5acb05a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:54.947386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-dfe98516-26ac-466a-a99d-c00f5acb05a7 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1724 microversion: 2.20 time: 0.202915 Sep 01 16:39:54.947933 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 397/766] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:54 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:55.162176 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-53b41e53-9097-41e5-80d1-2af051719b5f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:55.162731 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-53b41e53-9097-41e5-80d1-2af051719b5f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:55.169282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-53b41e53-9097-41e5-80d1-2af051719b5f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:55.169791 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-53b41e53-9097-41e5-80d1-2af051719b5f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:55.170226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-53b41e53-9097-41e5-80d1-2af051719b5f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:55.170940 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-53b41e53-9097-41e5-80d1-2af051719b5f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:55.171392 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-53b41e53-9097-41e5-80d1-2af051719b5f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:55.171818 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-53b41e53-9097-41e5-80d1-2af051719b5f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:55.311632 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-53b41e53-9097-41e5-80d1-2af051719b5f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:55.319315 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-53b41e53-9097-41e5-80d1-2af051719b5f tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.161065 Sep 01 16:39:55.319883 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 370/767] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:55 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:55.948864 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-032102c5-3a1c-4daa-adfd-73024685bc1d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:55.949506 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-032102c5-3a1c-4daa-adfd-73024685bc1d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:55.956628 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-032102c5-3a1c-4daa-adfd-73024685bc1d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:55.957109 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-032102c5-3a1c-4daa-adfd-73024685bc1d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:55.957568 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-032102c5-3a1c-4daa-adfd-73024685bc1d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:55.958285 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-032102c5-3a1c-4daa-adfd-73024685bc1d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:55.958745 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-032102c5-3a1c-4daa-adfd-73024685bc1d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:55.959187 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-032102c5-3a1c-4daa-adfd-73024685bc1d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:55.974987 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a25ec289-a231-4ac3-b8c4-e517ec6f206a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:55.975964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a25ec289-a231-4ac3-b8c4-e517ec6f206a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:55.984321 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a25ec289-a231-4ac3-b8c4-e517ec6f206a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:55.984937 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a25ec289-a231-4ac3-b8c4-e517ec6f206a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:55.985468 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a25ec289-a231-4ac3-b8c4-e517ec6f206a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:55.986285 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a25ec289-a231-4ac3-b8c4-e517ec6f206a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:55.987230 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a25ec289-a231-4ac3-b8c4-e517ec6f206a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:55.988473 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a25ec289-a231-4ac3-b8c4-e517ec6f206a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:56.122525 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-032102c5-3a1c-4daa-adfd-73024685bc1d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:56.130389 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-032102c5-3a1c-4daa-adfd-73024685bc1d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1576 microversion: 2.1 time: 0.185291 Sep 01 16:39:56.130966 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 398/768] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:55 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:56.341856 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2c87d688-7dc1-4152-9966-8f77999da155 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:56.342625 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2c87d688-7dc1-4152-9966-8f77999da155 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:56.354259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a25ec289-a231-4ac3-b8c4-e517ec6f206a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:56.377132 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c87d688-7dc1-4152-9966-8f77999da155 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:56.377626 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c87d688-7dc1-4152-9966-8f77999da155 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:56.378055 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c87d688-7dc1-4152-9966-8f77999da155 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:56.383269 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a25ec289-a231-4ac3-b8c4-e517ec6f206a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:56.384694 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a25ec289-a231-4ac3-b8c4-e517ec6f206a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:56.385846 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a25ec289-a231-4ac3-b8c4-e517ec6f206a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1724 microversion: 2.20 time: 0.418131 Sep 01 16:39:56.386440 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 371/769] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:55 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1724 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:56.387136 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c87d688-7dc1-4152-9966-8f77999da155 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:56.388172 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c87d688-7dc1-4152-9966-8f77999da155 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:56.388596 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c87d688-7dc1-4152-9966-8f77999da155 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:56.552553 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2c87d688-7dc1-4152-9966-8f77999da155 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:56.564449 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2c87d688-7dc1-4152-9966-8f77999da155 tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1519 microversion: 2.1 time: 0.227103 Sep 01 16:39:56.566080 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 399/770] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:56 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:57.076106 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-63fecb38-05cd-41f1-93a2-c3d27dd48702 req-9597b66a-9a1a-432a-ae2b-cda65d2a0f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13e447e7-8805-447e-8cf9-7771733bf00f", "name": "network-vif-deleted", "tag": "871bccd9-3596-40d8-8c9a-f29d5ba58a45"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:57.090947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-63fecb38-05cd-41f1-93a2-c3d27dd48702 req-9597b66a-9a1a-432a-ae2b-cda65d2a0f27 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:57.091549 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-63fecb38-05cd-41f1-93a2-c3d27dd48702 req-9597b66a-9a1a-432a-ae2b-cda65d2a0f27 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:57.092156 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-63fecb38-05cd-41f1-93a2-c3d27dd48702 req-9597b66a-9a1a-432a-ae2b-cda65d2a0f27 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:57.112485 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-63fecb38-05cd-41f1-93a2-c3d27dd48702 req-9597b66a-9a1a-432a-ae2b-cda65d2a0f27 service nova] Creating event network-vif-deleted:871bccd9-3596-40d8-8c9a-f29d5ba58a45 for instance 13e447e7-8805-447e-8cf9-7771733bf00f on hv-cinder-85220 Sep 01 16:39:57.120071 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-63fecb38-05cd-41f1-93a2-c3d27dd48702 req-9597b66a-9a1a-432a-ae2b-cda65d2a0f27 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050066 Sep 01 16:39:57.120860 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 372/771] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:39:57.154970 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-af663f18-bdd1-44aa-bd4f-ba7222cf9f67 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:57.155987 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-af663f18-bdd1-44aa-bd4f-ba7222cf9f67 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:57.169158 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af663f18-bdd1-44aa-bd4f-ba7222cf9f67 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:57.172090 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af663f18-bdd1-44aa-bd4f-ba7222cf9f67 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:57.172553 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af663f18-bdd1-44aa-bd4f-ba7222cf9f67 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:57.173272 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af663f18-bdd1-44aa-bd4f-ba7222cf9f67 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:57.173723 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af663f18-bdd1-44aa-bd4f-ba7222cf9f67 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:57.174152 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af663f18-bdd1-44aa-bd4f-ba7222cf9f67 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:57.288333 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-af663f18-bdd1-44aa-bd4f-ba7222cf9f67 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:57.302631 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-af663f18-bdd1-44aa-bd4f-ba7222cf9f67 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1508 microversion: 2.1 time: 0.152578 Sep 01 16:39:57.303668 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 400/772] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:57 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:57.421335 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-70189b46-4078-494c-ae38-838150ae0cc3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:57.422676 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-70189b46-4078-494c-ae38-838150ae0cc3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:57.435818 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-70189b46-4078-494c-ae38-838150ae0cc3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:57.437350 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-70189b46-4078-494c-ae38-838150ae0cc3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:57.438940 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-70189b46-4078-494c-ae38-838150ae0cc3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:57.440001 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1733101476", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-343666896", "security_groups": [{"name": "tempest-secgroup-smoke-829623400"}], "networks": [{"uuid": "b36a9745-9290-42e8-afea-e40aab2f41b5"}], "block_device_mapping_v2": [{"uuid": "8c9321a7-542c-4540-bba2-2a69a3753819", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:57.441297 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-70189b46-4078-494c-ae38-838150ae0cc3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:57.443185 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-70189b46-4078-494c-ae38-838150ae0cc3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:57.444234 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-70189b46-4078-494c-ae38-838150ae0cc3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:57.628320 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] validate_networks() for [('b36a9745-9290-42e8-afea-e40aab2f41b5', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:39:57.835389 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-70189b46-4078-494c-ae38-838150ae0cc3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:57.845612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-70189b46-4078-494c-ae38-838150ae0cc3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:57.847161 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-70189b46-4078-494c-ae38-838150ae0cc3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:57.848708 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-70189b46-4078-494c-ae38-838150ae0cc3 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1724 microversion: 2.20 time: 0.436171 Sep 01 16:39:57.850527 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 373/773] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:57 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1724 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:57.856976 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b1bd8122-e75b-4a33-950d-2d59ed7cbcad tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:57.857809 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b1bd8122-e75b-4a33-950d-2d59ed7cbcad tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:57.868130 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1bd8122-e75b-4a33-950d-2d59ed7cbcad tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:57.869098 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1bd8122-e75b-4a33-950d-2d59ed7cbcad tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:57.869759 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1bd8122-e75b-4a33-950d-2d59ed7cbcad tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:57.870769 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1bd8122-e75b-4a33-950d-2d59ed7cbcad tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:57.871499 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1bd8122-e75b-4a33-950d-2d59ed7cbcad tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:57.872784 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1bd8122-e75b-4a33-950d-2d59ed7cbcad tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:57.936608 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1bd8122-e75b-4a33-950d-2d59ed7cbcad tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:57.937422 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1bd8122-e75b-4a33-950d-2d59ed7cbcad tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:57.938202 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1bd8122-e75b-4a33-950d-2d59ed7cbcad tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:57.939417 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.objects.instance [None req-b1bd8122-e75b-4a33-950d-2d59ed7cbcad tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lazy-loading 'fault' on Instance uuid 13e447e7-8805-447e-8cf9-7771733bf00f {{(pid=127178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:39:58.013175 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b1bd8122-e75b-4a33-950d-2d59ed7cbcad tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8020db56bca04d61b5a6e40384c25715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4bbb5d3895c49fa8695d3bca946dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:58.031088 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b1bd8122-e75b-4a33-950d-2d59ed7cbcad tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 200 len: 1311 microversion: 2.1 time: 0.177785 Sep 01 16:39:58.034654 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 374/774] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:57 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 1311 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:58.329186 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:39:58.329772 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:39:58.330139 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:39:58.330619 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:39:58.331044 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:39:58.337711 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-1834b39e-3edb-4a22-918c-1d5f07dc8113 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:58.338777 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-1834b39e-3edb-4a22-918c-1d5f07dc8113 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:58.340718 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:58.341188 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:58.341805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:58.342856 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:58.343312 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:58.343718 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:58.354430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1834b39e-3edb-4a22-918c-1d5f07dc8113 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:58.355270 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1834b39e-3edb-4a22-918c-1d5f07dc8113 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:58.356057 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1834b39e-3edb-4a22-918c-1d5f07dc8113 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:58.357473 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1834b39e-3edb-4a22-918c-1d5f07dc8113 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:58.358544 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1834b39e-3edb-4a22-918c-1d5f07dc8113 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:58.359491 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1834b39e-3edb-4a22-918c-1d5f07dc8113 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:58.377694 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Getting quotas for project b683a11c21fe4dd389a006f051576a1b. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:39:58.383109 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Getting quotas for user aa6ad9c2c1294633a74782c668227886 and project b683a11c21fe4dd389a006f051576a1b. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:39:58.430728 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1834b39e-3edb-4a22-918c-1d5f07dc8113 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:58.431213 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1834b39e-3edb-4a22-918c-1d5f07dc8113 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:58.431666 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1834b39e-3edb-4a22-918c-1d5f07dc8113 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:58.432053 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.objects.instance [None req-1834b39e-3edb-4a22-918c-1d5f07dc8113 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lazy-loading 'fault' on Instance uuid de83f04b-508f-4b6f-88da-92857f482014 {{(pid=127178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:39:58.488595 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:39:58.491142 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c9321a7-542c-4540-bba2-2a69a3753819',volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:39:58.495622 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-1834b39e-3edb-4a22-918c-1d5f07dc8113 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:58.511615 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-1834b39e-3edb-4a22-918c-1d5f07dc8113 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 200 len: 1230 microversion: 2.1 time: 0.189061 Sep 01 16:39:58.513247 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 375/775] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:58 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 1230 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:58.670274 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2161cb3a-5b24-4335-a9e1-0ac37aec6a86 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.234555 Sep 01 16:39:58.671301 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 401/776] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:39:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 16:39:58.682011 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-09c27de0-e076-4669-a190-c2c5eb8f67b5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:58.682646 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-09c27de0-e076-4669-a190-c2c5eb8f67b5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:58.757843 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-09c27de0-e076-4669-a190-c2c5eb8f67b5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:58.781804 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-09c27de0-e076-4669-a190-c2c5eb8f67b5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1088 microversion: 2.1 time: 0.103539 Sep 01 16:39:58.782418 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 376/777] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:58 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1088 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:58.898415 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-baa8de0b-789b-4ffd-9ef5-949445e3bcb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:58.899558 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-baa8de0b-789b-4ffd-9ef5-949445e3bcb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:58.911171 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-baa8de0b-789b-4ffd-9ef5-949445e3bcb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:58.912004 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-baa8de0b-789b-4ffd-9ef5-949445e3bcb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:58.912726 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-baa8de0b-789b-4ffd-9ef5-949445e3bcb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:58.914676 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-baa8de0b-789b-4ffd-9ef5-949445e3bcb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:58.915697 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-baa8de0b-789b-4ffd-9ef5-949445e3bcb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:58.916700 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-baa8de0b-789b-4ffd-9ef5-949445e3bcb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:58.948747 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:59.071316 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-5ad9ef14-5ae3-48a2-ab58-07ff9362106e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:59.072410 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-5ad9ef14-5ae3-48a2-ab58-07ff9362106e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] [instance: 13e447e7-8805-447e-8cf9-7771733bf00f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:59.082996 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5ad9ef14-5ae3-48a2-ab58-07ff9362106e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:59.083863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5ad9ef14-5ae3-48a2-ab58-07ff9362106e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:59.084909 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5ad9ef14-5ae3-48a2-ab58-07ff9362106e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:59.086132 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5ad9ef14-5ae3-48a2-ab58-07ff9362106e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:59.087199 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5ad9ef14-5ae3-48a2-ab58-07ff9362106e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:59.087966 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-5ad9ef14-5ae3-48a2-ab58-07ff9362106e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:59.096159 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:59.107843 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-baa8de0b-789b-4ffd-9ef5-949445e3bcb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:59.113462 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-5ad9ef14-5ae3-48a2-ab58-07ff9362106e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] HTTP exception thrown: Instance 13e447e7-8805-447e-8cf9-7771733bf00f could not be found. Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-5ad9ef14-5ae3-48a2-ab58-07ff9362106e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Request method failure captured: Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f HTTP/1.1 Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN8F17LXR9QZKG1_VIEG9-p8CRv4W7TM6E6dScWkaJQxBYZmnEi3ulzPAVr0-b20dizp00dSNiiSfWFSUTO8kWHVwi7TysP99jGN0Cq7VR3f5DEHM8MBqhsccbwVjs5uyEAzYbVKihge-cMSlpBXs8gzVRuYafB1F18mDaUBDx4zRr4 Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: b4bbb5d3895c49fa8695d3bca946dbea Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1309500920 Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:39:59.116715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:39:59.118606 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4bbb5d3895c49fa8695d3bca946dbea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:39:59.118606 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1309500920 Sep 01 16:39:59.118606 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: b4bbb5d3895c49fa8695d3bca946dbea Sep 01 16:39:59.118606 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1309500920 Sep 01 16:39:59.118606 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-ServerRescueNegativeTestJSON-1309500920-project Sep 01 16:39:59.118606 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:39:59.118606 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:39:59.118606 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: 8020db56bca04d61b5a6e40384c25715 Sep 01 16:39:59.118606 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1309500920-project Sep 01 16:39:59.118606 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:39:59.118606 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance 13e447e7-8805-447e-8cf9-7771733bf00f could not be found. Sep 01 16:39:59.118606 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': '13e447e7-8805-447e-8cf9-7771733bf00f'} Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e447e7-8805-447e-8cf9-7771733bf00f could not be found. Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:39:59.119559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e447e7-8805-447e-8cf9-7771733bf00f could not be found. Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e447e7-8805-447e-8cf9-7771733bf00f could not be found. Sep 01 16:39:59.124426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:39:59.127139 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-5ad9ef14-5ae3-48a2-ab58-07ff9362106e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] Returning 404 to user: Instance 13e447e7-8805-447e-8cf9-7771733bf00f could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:39:59.127139 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-5ad9ef14-5ae3-48a2-ab58-07ff9362106e tempest-ServerRescueNegativeTestJSON-1309500920 tempest-ServerRescueNegativeTestJSON-1309500920-project] 10.222.0.18 "GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f" status: 404 len: 111 microversion: 2.1 time: 0.055015 Sep 01 16:39:59.127139 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 377/778] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:59 2022] GET /compute/v2.1/servers/13e447e7-8805-447e-8cf9-7771733bf00f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:39:59.127609 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-baa8de0b-789b-4ffd-9ef5-949445e3bcb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:59.127609 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-baa8de0b-789b-4ffd-9ef5-949445e3bcb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:59.127609 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-baa8de0b-789b-4ffd-9ef5-949445e3bcb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1724 microversion: 2.20 time: 0.241208 Sep 01 16:39:59.143401 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 402/779] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:58 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:59.152719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-8511ad68-a5f5-41f1-88ea-7a60fc556fd4 req-8deb11a3-3fa3-4b1e-8cc8-3cf0fd0b5cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de83f04b-508f-4b6f-88da-92857f482014", "name": "network-vif-deleted", "tag": "9ed23239-98a4-43e2-9a12-3bdb7d38814e"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:59.166178 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-8511ad68-a5f5-41f1-88ea-7a60fc556fd4 req-8deb11a3-3fa3-4b1e-8cc8-3cf0fd0b5cf3 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:59.166960 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-8511ad68-a5f5-41f1-88ea-7a60fc556fd4 req-8deb11a3-3fa3-4b1e-8cc8-3cf0fd0b5cf3 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:59.167624 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-8511ad68-a5f5-41f1-88ea-7a60fc556fd4 req-8deb11a3-3fa3-4b1e-8cc8-3cf0fd0b5cf3 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:59.180076 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-8511ad68-a5f5-41f1-88ea-7a60fc556fd4 req-8deb11a3-3fa3-4b1e-8cc8-3cf0fd0b5cf3 service nova] Creating event network-vif-deleted:9ed23239-98a4-43e2-9a12-3bdb7d38814e for instance de83f04b-508f-4b6f-88da-92857f482014 on hv-cinder-85220 Sep 01 16:39:59.185359 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-8511ad68-a5f5-41f1-88ea-7a60fc556fd4 req-8deb11a3-3fa3-4b1e-8cc8-3cf0fd0b5cf3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040757 Sep 01 16:39:59.186140 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 378/780] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:39:59.545643 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-81c0367e-f297-4d5a-b6a4-05c300070ee1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:59.547596 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-81c0367e-f297-4d5a-b6a4-05c300070ee1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:59.559777 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81c0367e-f297-4d5a-b6a4-05c300070ee1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:59.560818 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81c0367e-f297-4d5a-b6a4-05c300070ee1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:59.561705 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81c0367e-f297-4d5a-b6a4-05c300070ee1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:59.563370 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81c0367e-f297-4d5a-b6a4-05c300070ee1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:59.564511 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81c0367e-f297-4d5a-b6a4-05c300070ee1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:59.565539 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81c0367e-f297-4d5a-b6a4-05c300070ee1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:59.593949 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-81c0367e-f297-4d5a-b6a4-05c300070ee1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] HTTP exception thrown: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-81c0367e-f297-4d5a-b6a4-05c300070ee1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Request method failure captured: Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 HTTP/1.1 Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN97HOKS9R-V8DgrBoRJO26WuPh_i2vM7On4Gl0HRk0g1m7yeMKkG5i083NgJ-nZpc0UQUxBDaiPb0hMA7EoGz6-TWv1RfzGfrvYBpMeN9gFsW_iVL61zLNeE3FauMkLRNWoLCx9Vl2WG6Q8cLIFRhdExCCMwWlX8XLFz3EoF1zKnBA Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 4b6bf55e6c5e47f3895e135c4d6dc3ff Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-TestVolumeBootPattern-1980304612 Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:39:59.597231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:39:59.598935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:39:59.598935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-TestVolumeBootPattern-1980304612 Sep 01 16:39:59.598935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 4b6bf55e6c5e47f3895e135c4d6dc3ff Sep 01 16:39:59.598935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-TestVolumeBootPattern-1980304612 Sep 01 16:39:59.598935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-TestVolumeBootPattern-1980304612-project Sep 01 16:39:59.598935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:39:59.598935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:39:59.598935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: a3059f5115bb4bad837daf9f18752143 Sep 01 16:39:59.598935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-TestVolumeBootPattern-1980304612-project Sep 01 16:39:59.598935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:39:59.598935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. Sep 01 16:39:59.598935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': 'de83f04b-508f-4b6f-88da-92857f482014'} Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:39:59.599716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. Sep 01 16:39:59.602124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:39:59.603454 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-81c0367e-f297-4d5a-b6a4-05c300070ee1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Returning 404 to user: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:39:59.603454 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-81c0367e-f297-4d5a-b6a4-05c300070ee1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 404 len: 111 microversion: 2.1 time: 0.062161 Sep 01 16:39:59.603454 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 403/781] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:59 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:39:59.719868 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1989936131", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-346534431", "security_groups": [{"name": "tempest-secgroup-smoke-1444885176"}], "block_device_mapping_v2": [{"uuid": "c0d5f754-fc23-4943-8848-b6f691138e19", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5fae8c7f-11cf-4ab3-8c34-e624963abdb8"}]}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:59.802970 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b689c2b2-e2c2-4d9d-981b-dab3ddb4ec40 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:59.803577 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b689c2b2-e2c2-4d9d-981b-dab3ddb4ec40 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:59.809605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b689c2b2-e2c2-4d9d-981b-dab3ddb4ec40 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:59.810091 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b689c2b2-e2c2-4d9d-981b-dab3ddb4ec40 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:59.810549 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b689c2b2-e2c2-4d9d-981b-dab3ddb4ec40 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:59.811245 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b689c2b2-e2c2-4d9d-981b-dab3ddb4ec40 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:59.811692 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b689c2b2-e2c2-4d9d-981b-dab3ddb4ec40 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:59.812110 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b689c2b2-e2c2-4d9d-981b-dab3ddb4ec40 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:59.874950 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b689c2b2-e2c2-4d9d-981b-dab3ddb4ec40 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:59.882911 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b689c2b2-e2c2-4d9d-981b-dab3ddb4ec40 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1186 microversion: 2.1 time: 0.083679 Sep 01 16:39:59.883492 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 404/782] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:59 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1186 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:59.906368 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.network.neutron [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] validate_networks() for [('5fae8c7f-11cf-4ab3-8c34-e624963abdb8', None, None, None, None, None)] {{(pid=127178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:40:00.162541 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f984c6cd-4e92-4d5d-9782-723107e786eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:00.163578 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f984c6cd-4e92-4d5d-9782-723107e786eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:00.170211 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f984c6cd-4e92-4d5d-9782-723107e786eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:00.170818 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f984c6cd-4e92-4d5d-9782-723107e786eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:00.171317 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f984c6cd-4e92-4d5d-9782-723107e786eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:00.172078 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f984c6cd-4e92-4d5d-9782-723107e786eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:00.172616 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f984c6cd-4e92-4d5d-9782-723107e786eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:00.173289 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f984c6cd-4e92-4d5d-9782-723107e786eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:00.316429 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f984c6cd-4e92-4d5d-9782-723107e786eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:00.331048 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f984c6cd-4e92-4d5d-9782-723107e786eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:00.336918 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f984c6cd-4e92-4d5d-9782-723107e786eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:00.338366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f984c6cd-4e92-4d5d-9782-723107e786eb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1724 microversion: 2.20 time: 0.180334 Sep 01 16:40:00.339258 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 405/783] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:00 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:00.816337 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Flavor limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:40:00.816987 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Image limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:40:00.817543 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Flavor pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:40:00.818012 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Image pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:40:00.818491 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:40:00.829570 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:00.830064 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:00.830713 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:00.831659 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:00.832367 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:00.832879 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:00.854657 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Getting quotas for project 4b6bf55e6c5e47f3895e135c4d6dc3ff. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:40:00.859892 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Getting quotas for user a3059f5115bb4bad837daf9f18752143 and project 4b6bf55e6c5e47f3895e135c4d6dc3ff. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:40:00.907456 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-39569767-da7d-40d9-896d-239a5fa27dec tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:00.908169 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-39569767-da7d-40d9-896d-239a5fa27dec tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:00.916345 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-39569767-da7d-40d9-896d-239a5fa27dec tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:00.916839 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-39569767-da7d-40d9-896d-239a5fa27dec tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:00.917276 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-39569767-da7d-40d9-896d-239a5fa27dec tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:00.917980 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-39569767-da7d-40d9-896d-239a5fa27dec tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:00.918494 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-39569767-da7d-40d9-896d-239a5fa27dec tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:00.919496 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-39569767-da7d-40d9-896d-239a5fa27dec tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:00.931998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Going to run 1 instances... {{(pid=127178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:40:00.934374 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c0d5f754-fc23-4943-8848-b6f691138e19',volume_size=None,volume_type=None)] {{(pid=127178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:40:01.030694 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-39569767-da7d-40d9-896d-239a5fa27dec tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:01.039706 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-39569767-da7d-40d9-896d-239a5fa27dec tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1204 microversion: 2.1 time: 0.138601 Sep 01 16:40:01.053418 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 406/784] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:00 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1204 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:01.122402 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-608ee577-5580-4019-99c9-be8c89db915e tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.408242 Sep 01 16:40:01.123219 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 379/785] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:39:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:40:01.135305 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7541e4fc-1010-41fb-a0d0-943c37d30bb5 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:01.135916 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7541e4fc-1010-41fb-a0d0-943c37d30bb5 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:01.201823 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7541e4fc-1010-41fb-a0d0-943c37d30bb5 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:01.210861 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7541e4fc-1010-41fb-a0d0-943c37d30bb5 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1094 microversion: 2.1 time: 0.079818 Sep 01 16:40:01.211756 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 407/786] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:01 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:01.368937 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-991e1f37-4a21-43c2-b345-8196fb0f8398 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:01.369673 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-991e1f37-4a21-43c2-b345-8196fb0f8398 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:01.383991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-991e1f37-4a21-43c2-b345-8196fb0f8398 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:01.384571 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-991e1f37-4a21-43c2-b345-8196fb0f8398 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:01.385072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-991e1f37-4a21-43c2-b345-8196fb0f8398 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:01.385851 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-991e1f37-4a21-43c2-b345-8196fb0f8398 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:01.386438 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-991e1f37-4a21-43c2-b345-8196fb0f8398 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:01.387072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-991e1f37-4a21-43c2-b345-8196fb0f8398 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:01.716474 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-991e1f37-4a21-43c2-b345-8196fb0f8398 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:01.725749 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-991e1f37-4a21-43c2-b345-8196fb0f8398 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:01.727567 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-991e1f37-4a21-43c2-b345-8196fb0f8398 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:01.728984 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-991e1f37-4a21-43c2-b345-8196fb0f8398 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1724 microversion: 2.20 time: 0.370227 Sep 01 16:40:01.743757 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 380/787] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:01 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1724 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:02.061738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b5dadcb9-7d50-4023-bdd4-f9c8514a9f74 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:02.062390 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b5dadcb9-7d50-4023-bdd4-f9c8514a9f74 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:02.069742 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5dadcb9-7d50-4023-bdd4-f9c8514a9f74 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:02.070279 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5dadcb9-7d50-4023-bdd4-f9c8514a9f74 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:02.070718 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5dadcb9-7d50-4023-bdd4-f9c8514a9f74 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:02.071479 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5dadcb9-7d50-4023-bdd4-f9c8514a9f74 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:02.071926 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5dadcb9-7d50-4023-bdd4-f9c8514a9f74 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:02.072339 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5dadcb9-7d50-4023-bdd4-f9c8514a9f74 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:02.233530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6930f91c-d900-4248-a846-4a1cf374ff97 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:02.234121 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-6930f91c-d900-4248-a846-4a1cf374ff97 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:02.243563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6930f91c-d900-4248-a846-4a1cf374ff97 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:02.251743 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6930f91c-d900-4248-a846-4a1cf374ff97 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:02.252386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b5dadcb9-7d50-4023-bdd4-f9c8514a9f74 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:02.252849 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6930f91c-d900-4248-a846-4a1cf374ff97 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:02.253830 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6930f91c-d900-4248-a846-4a1cf374ff97 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:02.254700 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6930f91c-d900-4248-a846-4a1cf374ff97 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:02.255347 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6930f91c-d900-4248-a846-4a1cf374ff97 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:02.262127 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b5dadcb9-7d50-4023-bdd4-f9c8514a9f74 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1259 microversion: 2.1 time: 0.204907 Sep 01 16:40:02.265466 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 408/788] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:02 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1259 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:02.458519 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-6930f91c-d900-4248-a846-4a1cf374ff97 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:02.470292 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-6930f91c-d900-4248-a846-4a1cf374ff97 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1192 microversion: 2.1 time: 0.241112 Sep 01 16:40:02.470973 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 381/789] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:02 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1192 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:02.753029 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a2bdef81-4da9-48f8-93f5-535e344a6d16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:02.753819 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a2bdef81-4da9-48f8-93f5-535e344a6d16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:02.761285 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2bdef81-4da9-48f8-93f5-535e344a6d16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:02.762155 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2bdef81-4da9-48f8-93f5-535e344a6d16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:02.763511 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2bdef81-4da9-48f8-93f5-535e344a6d16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:02.764469 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2bdef81-4da9-48f8-93f5-535e344a6d16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:02.766149 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2bdef81-4da9-48f8-93f5-535e344a6d16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:02.766952 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2bdef81-4da9-48f8-93f5-535e344a6d16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:02.937068 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a2bdef81-4da9-48f8-93f5-535e344a6d16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:02.945692 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a2bdef81-4da9-48f8-93f5-535e344a6d16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:02.947489 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a2bdef81-4da9-48f8-93f5-535e344a6d16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:02.948773 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a2bdef81-4da9-48f8-93f5-535e344a6d16 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1724 microversion: 2.20 time: 0.199855 Sep 01 16:40:02.949433 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 409/790] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:02 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:03.285553 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-1b1d41ec-074d-4a91-b871-f6be8db09323 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:03.286164 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-1b1d41ec-074d-4a91-b871-f6be8db09323 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:03.294115 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b1d41ec-074d-4a91-b871-f6be8db09323 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:03.294635 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b1d41ec-074d-4a91-b871-f6be8db09323 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:03.295097 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b1d41ec-074d-4a91-b871-f6be8db09323 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:03.295991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b1d41ec-074d-4a91-b871-f6be8db09323 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:03.296449 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b1d41ec-074d-4a91-b871-f6be8db09323 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:03.297057 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1b1d41ec-074d-4a91-b871-f6be8db09323 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:03.493023 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1ee3f8aa-b7ac-4575-8754-fe1b2af68c06 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:03.493657 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1ee3f8aa-b7ac-4575-8754-fe1b2af68c06 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:03.500838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ee3f8aa-b7ac-4575-8754-fe1b2af68c06 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:03.501301 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ee3f8aa-b7ac-4575-8754-fe1b2af68c06 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:03.501726 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ee3f8aa-b7ac-4575-8754-fe1b2af68c06 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:03.502465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ee3f8aa-b7ac-4575-8754-fe1b2af68c06 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:03.502911 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ee3f8aa-b7ac-4575-8754-fe1b2af68c06 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:03.503532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ee3f8aa-b7ac-4575-8754-fe1b2af68c06 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:03.566782 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1ee3f8aa-b7ac-4575-8754-fe1b2af68c06 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:03.574466 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1ee3f8aa-b7ac-4575-8754-fe1b2af68c06 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1198 microversion: 2.1 time: 0.085829 Sep 01 16:40:03.575713 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 410/791] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:03 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1198 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:03.949265 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-1b1d41ec-074d-4a91-b871-f6be8db09323 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:03.957160 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-1b1d41ec-074d-4a91-b871-f6be8db09323 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1259 microversion: 2.1 time: 0.675597 Sep 01 16:40:03.957923 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 382/792] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:03 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1259 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:03.973589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-29cab244-427f-4813-bedd-d36eaf8b7cd6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:03.974435 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-29cab244-427f-4813-bedd-d36eaf8b7cd6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:03.982626 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29cab244-427f-4813-bedd-d36eaf8b7cd6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:03.983270 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29cab244-427f-4813-bedd-d36eaf8b7cd6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:03.983704 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29cab244-427f-4813-bedd-d36eaf8b7cd6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:03.984395 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29cab244-427f-4813-bedd-d36eaf8b7cd6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:03.984846 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29cab244-427f-4813-bedd-d36eaf8b7cd6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:03.985264 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29cab244-427f-4813-bedd-d36eaf8b7cd6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:04.115900 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-29cab244-427f-4813-bedd-d36eaf8b7cd6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:04.125542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-29cab244-427f-4813-bedd-d36eaf8b7cd6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:04.127026 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-29cab244-427f-4813-bedd-d36eaf8b7cd6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:04.128193 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-29cab244-427f-4813-bedd-d36eaf8b7cd6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1724 microversion: 2.20 time: 0.159055 Sep 01 16:40:04.128739 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 411/793] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:03 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:04.287811 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-3f9867d5-8826-4d75-ae1a-99baf41afb1d req-5ae38fde-d10b-48f8-9505-9fc13ea06585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad0df24-0b95-4583-9017-6322bebd55a0", "tag": "85932ff9-5198-4161-a8d5-3f43070b4618"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:04.299400 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-3f9867d5-8826-4d75-ae1a-99baf41afb1d req-5ae38fde-d10b-48f8-9505-9fc13ea06585 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:04.299871 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-3f9867d5-8826-4d75-ae1a-99baf41afb1d req-5ae38fde-d10b-48f8-9505-9fc13ea06585 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:04.300300 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-3f9867d5-8826-4d75-ae1a-99baf41afb1d req-5ae38fde-d10b-48f8-9505-9fc13ea06585 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:04.311598 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-3f9867d5-8826-4d75-ae1a-99baf41afb1d req-5ae38fde-d10b-48f8-9505-9fc13ea06585 service nova] Creating event network-changed:85932ff9-5198-4161-a8d5-3f43070b4618 for instance fad0df24-0b95-4583-9017-6322bebd55a0 on hv-cinder-85220 Sep 01 16:40:04.316620 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-3f9867d5-8826-4d75-ae1a-99baf41afb1d req-5ae38fde-d10b-48f8-9505-9fc13ea06585 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040942 Sep 01 16:40:04.317214 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 383/794] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:04.595625 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6ab25173-e435-462e-ada1-b8013f2d8313 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:04.596345 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6ab25173-e435-462e-ada1-b8013f2d8313 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:04.608336 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6ab25173-e435-462e-ada1-b8013f2d8313 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:04.609349 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6ab25173-e435-462e-ada1-b8013f2d8313 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:04.610227 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6ab25173-e435-462e-ada1-b8013f2d8313 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:04.611582 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6ab25173-e435-462e-ada1-b8013f2d8313 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:04.612486 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6ab25173-e435-462e-ada1-b8013f2d8313 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:04.613398 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6ab25173-e435-462e-ada1-b8013f2d8313 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:04.865222 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6ab25173-e435-462e-ada1-b8013f2d8313 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:04.874013 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6ab25173-e435-462e-ada1-b8013f2d8313 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1266 microversion: 2.1 time: 0.282146 Sep 01 16:40:04.874689 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 412/795] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:04 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:04.982151 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-507b5832-7279-4710-9422-5871ba6e3fdd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:04.983120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-507b5832-7279-4710-9422-5871ba6e3fdd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:04.993215 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-507b5832-7279-4710-9422-5871ba6e3fdd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:04.994519 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-507b5832-7279-4710-9422-5871ba6e3fdd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:04.995141 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-507b5832-7279-4710-9422-5871ba6e3fdd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:04.996030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-507b5832-7279-4710-9422-5871ba6e3fdd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:04.997197 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-507b5832-7279-4710-9422-5871ba6e3fdd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:04.997794 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-507b5832-7279-4710-9422-5871ba6e3fdd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:05.152049 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a6a659fb-74ea-4754-af1f-f5b704b0f29b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:05.152955 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a6a659fb-74ea-4754-af1f-f5b704b0f29b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:05.159026 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a6a659fb-74ea-4754-af1f-f5b704b0f29b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:05.159506 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a6a659fb-74ea-4754-af1f-f5b704b0f29b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:05.159935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a6a659fb-74ea-4754-af1f-f5b704b0f29b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:05.160638 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a6a659fb-74ea-4754-af1f-f5b704b0f29b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:05.161085 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a6a659fb-74ea-4754-af1f-f5b704b0f29b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:05.161498 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a6a659fb-74ea-4754-af1f-f5b704b0f29b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:05.307304 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a6a659fb-74ea-4754-af1f-f5b704b0f29b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:05.317326 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a6a659fb-74ea-4754-af1f-f5b704b0f29b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:05.319478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a6a659fb-74ea-4754-af1f-f5b704b0f29b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:05.320696 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a6a659fb-74ea-4754-af1f-f5b704b0f29b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1724 microversion: 2.20 time: 0.172510 Sep 01 16:40:05.321275 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 413/796] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:05 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:05.418934 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-507b5832-7279-4710-9422-5871ba6e3fdd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:05.427766 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-507b5832-7279-4710-9422-5871ba6e3fdd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1259 microversion: 2.1 time: 0.451993 Sep 01 16:40:05.428344 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 384/797] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:04 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1259 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:05.895316 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6e96d26d-a29e-473f-807d-4d4a95bcc57b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:05.895926 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6e96d26d-a29e-473f-807d-4d4a95bcc57b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:05.902309 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e96d26d-a29e-473f-807d-4d4a95bcc57b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:05.902803 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e96d26d-a29e-473f-807d-4d4a95bcc57b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:05.903235 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e96d26d-a29e-473f-807d-4d4a95bcc57b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:05.903925 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e96d26d-a29e-473f-807d-4d4a95bcc57b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:05.904376 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e96d26d-a29e-473f-807d-4d4a95bcc57b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:05.904796 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e96d26d-a29e-473f-807d-4d4a95bcc57b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:06.038718 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6e96d26d-a29e-473f-807d-4d4a95bcc57b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:06.047292 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6e96d26d-a29e-473f-807d-4d4a95bcc57b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1266 microversion: 2.1 time: 0.155782 Sep 01 16:40:06.047999 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 414/798] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:05 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:06.344541 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d9e6dd08-29a7-4c01-9a03-7407276708b1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:06.345175 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d9e6dd08-29a7-4c01-9a03-7407276708b1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:06.352175 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d9e6dd08-29a7-4c01-9a03-7407276708b1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:06.352662 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d9e6dd08-29a7-4c01-9a03-7407276708b1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:06.353096 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d9e6dd08-29a7-4c01-9a03-7407276708b1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:06.353828 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d9e6dd08-29a7-4c01-9a03-7407276708b1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:06.354363 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d9e6dd08-29a7-4c01-9a03-7407276708b1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:06.354787 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d9e6dd08-29a7-4c01-9a03-7407276708b1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:06.448383 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-81412a79-32b3-4ef7-a784-3c19f67f8ad2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:06.449037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-81412a79-32b3-4ef7-a784-3c19f67f8ad2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:06.455605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81412a79-32b3-4ef7-a784-3c19f67f8ad2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:06.456085 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81412a79-32b3-4ef7-a784-3c19f67f8ad2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:06.456577 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81412a79-32b3-4ef7-a784-3c19f67f8ad2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:06.457263 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81412a79-32b3-4ef7-a784-3c19f67f8ad2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:06.457705 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81412a79-32b3-4ef7-a784-3c19f67f8ad2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:06.458119 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81412a79-32b3-4ef7-a784-3c19f67f8ad2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:06.595553 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-81412a79-32b3-4ef7-a784-3c19f67f8ad2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:06.603980 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-81412a79-32b3-4ef7-a784-3c19f67f8ad2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1259 microversion: 2.1 time: 0.159747 Sep 01 16:40:06.604819 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 415/799] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:06 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:06.715942 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-257a5ce4-2a34-4603-a219-f10fb270e7ea req-d7bc9e8c-c921-4c39-8de8-771ae0c2504b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec8a5228-091c-490d-8790-3cd53e77b5d1", "tag": "086e5891-69d8-40bc-9506-7d948bca1db9"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:06.727280 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-257a5ce4-2a34-4603-a219-f10fb270e7ea req-d7bc9e8c-c921-4c39-8de8-771ae0c2504b service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:06.728038 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-257a5ce4-2a34-4603-a219-f10fb270e7ea req-d7bc9e8c-c921-4c39-8de8-771ae0c2504b service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:06.728670 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-257a5ce4-2a34-4603-a219-f10fb270e7ea req-d7bc9e8c-c921-4c39-8de8-771ae0c2504b service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:06.743140 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-257a5ce4-2a34-4603-a219-f10fb270e7ea req-d7bc9e8c-c921-4c39-8de8-771ae0c2504b service nova] Creating event network-changed:086e5891-69d8-40bc-9506-7d948bca1db9 for instance ec8a5228-091c-490d-8790-3cd53e77b5d1 on hv-cinder-85220 Sep 01 16:40:06.749123 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-257a5ce4-2a34-4603-a219-f10fb270e7ea req-d7bc9e8c-c921-4c39-8de8-771ae0c2504b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039409 Sep 01 16:40:06.749725 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 416/800] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:06.773506 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d9e6dd08-29a7-4c01-9a03-7407276708b1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:06.788602 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d9e6dd08-29a7-4c01-9a03-7407276708b1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:06.790042 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d9e6dd08-29a7-4c01-9a03-7407276708b1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:06.791250 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d9e6dd08-29a7-4c01-9a03-7407276708b1 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1724 microversion: 2.20 time: 0.451401 Sep 01 16:40:06.794468 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 385/801] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:06 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1724 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:07.068927 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0d7aa182-1bbc-4532-ae4c-e26d2a19425d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:07.071069 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0d7aa182-1bbc-4532-ae4c-e26d2a19425d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:07.078374 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d7aa182-1bbc-4532-ae4c-e26d2a19425d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:07.078932 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d7aa182-1bbc-4532-ae4c-e26d2a19425d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:07.079427 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d7aa182-1bbc-4532-ae4c-e26d2a19425d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:07.080193 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d7aa182-1bbc-4532-ae4c-e26d2a19425d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:07.080722 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d7aa182-1bbc-4532-ae4c-e26d2a19425d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:07.081204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d7aa182-1bbc-4532-ae4c-e26d2a19425d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:07.230566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0d7aa182-1bbc-4532-ae4c-e26d2a19425d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:07.238813 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0d7aa182-1bbc-4532-ae4c-e26d2a19425d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1266 microversion: 2.1 time: 0.174010 Sep 01 16:40:07.239838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 417/802] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:07 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:07.629220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c21bb773-e9cf-48e3-a905-0aa544b82801 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:07.629899 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c21bb773-e9cf-48e3-a905-0aa544b82801 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:07.636478 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c21bb773-e9cf-48e3-a905-0aa544b82801 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:07.637092 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c21bb773-e9cf-48e3-a905-0aa544b82801 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:07.637604 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c21bb773-e9cf-48e3-a905-0aa544b82801 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:07.638430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c21bb773-e9cf-48e3-a905-0aa544b82801 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:07.638948 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c21bb773-e9cf-48e3-a905-0aa544b82801 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:07.639465 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c21bb773-e9cf-48e3-a905-0aa544b82801 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:07.817273 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-86536142-0f86-4900-bf11-ba4a3f8f1b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:07.818851 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-86536142-0f86-4900-bf11-ba4a3f8f1b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:07.825731 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-86536142-0f86-4900-bf11-ba4a3f8f1b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:07.826577 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-86536142-0f86-4900-bf11-ba4a3f8f1b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:07.827293 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-86536142-0f86-4900-bf11-ba4a3f8f1b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:07.827977 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-86536142-0f86-4900-bf11-ba4a3f8f1b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:07.828732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-86536142-0f86-4900-bf11-ba4a3f8f1b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:07.829296 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-86536142-0f86-4900-bf11-ba4a3f8f1b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:07.861740 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c21bb773-e9cf-48e3-a905-0aa544b82801 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:07.882663 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c21bb773-e9cf-48e3-a905-0aa544b82801 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1259 microversion: 2.1 time: 0.257561 Sep 01 16:40:07.894964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 386/803] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:07 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1259 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:07.979367 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-86536142-0f86-4900-bf11-ba4a3f8f1b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:07.988698 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-86536142-0f86-4900-bf11-ba4a3f8f1b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:07.990126 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-86536142-0f86-4900-bf11-ba4a3f8f1b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:07.991305 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-86536142-0f86-4900-bf11-ba4a3f8f1b1f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1745 microversion: 2.20 time: 0.178401 Sep 01 16:40:08.006260 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 418/804] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:07 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:08.261096 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ce179bb4-e716-4982-931d-ea36093c4446 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:08.262832 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ce179bb4-e716-4982-931d-ea36093c4446 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:08.268993 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ce179bb4-e716-4982-931d-ea36093c4446 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:08.269467 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ce179bb4-e716-4982-931d-ea36093c4446 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:08.269892 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ce179bb4-e716-4982-931d-ea36093c4446 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:08.270592 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ce179bb4-e716-4982-931d-ea36093c4446 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:08.271037 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ce179bb4-e716-4982-931d-ea36093c4446 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:08.271451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ce179bb4-e716-4982-931d-ea36093c4446 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:08.413327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ce179bb4-e716-4982-931d-ea36093c4446 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:08.422377 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ce179bb4-e716-4982-931d-ea36093c4446 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1266 microversion: 2.1 time: 0.165419 Sep 01 16:40:08.422944 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 387/805] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:08 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:08.905291 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c273d857-6555-4057-ba09-59bf1f0942bf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:08.906379 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c273d857-6555-4057-ba09-59bf1f0942bf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:08.910065 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:08.915334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c273d857-6555-4057-ba09-59bf1f0942bf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:08.915770 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c273d857-6555-4057-ba09-59bf1f0942bf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:08.916273 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c273d857-6555-4057-ba09-59bf1f0942bf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:08.917254 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c273d857-6555-4057-ba09-59bf1f0942bf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:08.917967 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c273d857-6555-4057-ba09-59bf1f0942bf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:08.919129 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c273d857-6555-4057-ba09-59bf1f0942bf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:09.016544 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d3ecb6b1-7b31-4519-8b77-b0912c97f9ec tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:09.017250 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d3ecb6b1-7b31-4519-8b77-b0912c97f9ec tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:09.025479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3ecb6b1-7b31-4519-8b77-b0912c97f9ec tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:09.025986 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3ecb6b1-7b31-4519-8b77-b0912c97f9ec tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:09.028756 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3ecb6b1-7b31-4519-8b77-b0912c97f9ec tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:09.029401 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3ecb6b1-7b31-4519-8b77-b0912c97f9ec tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:09.029855 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3ecb6b1-7b31-4519-8b77-b0912c97f9ec tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:09.030381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3ecb6b1-7b31-4519-8b77-b0912c97f9ec tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:09.118075 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c273d857-6555-4057-ba09-59bf1f0942bf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:09.126786 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c273d857-6555-4057-ba09-59bf1f0942bf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1259 microversion: 2.1 time: 0.226482 Sep 01 16:40:09.127629 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 419/806] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:08 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:09.165499 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d3ecb6b1-7b31-4519-8b77-b0912c97f9ec tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:09.174790 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d3ecb6b1-7b31-4519-8b77-b0912c97f9ec tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:09.176271 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d3ecb6b1-7b31-4519-8b77-b0912c97f9ec tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:09.177444 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d3ecb6b1-7b31-4519-8b77-b0912c97f9ec tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1745 microversion: 2.20 time: 0.165361 Sep 01 16:40:09.177998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 388/807] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:09 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:09.444021 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ff9b9db7-b81c-4e84-a7a2-d879f27266fa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:09.447023 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ff9b9db7-b81c-4e84-a7a2-d879f27266fa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:09.455458 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff9b9db7-b81c-4e84-a7a2-d879f27266fa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:09.456018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff9b9db7-b81c-4e84-a7a2-d879f27266fa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:09.456455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff9b9db7-b81c-4e84-a7a2-d879f27266fa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:09.457153 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff9b9db7-b81c-4e84-a7a2-d879f27266fa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:09.457692 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff9b9db7-b81c-4e84-a7a2-d879f27266fa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:09.458192 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff9b9db7-b81c-4e84-a7a2-d879f27266fa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:09.609086 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ff9b9db7-b81c-4e84-a7a2-d879f27266fa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:09.617008 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ff9b9db7-b81c-4e84-a7a2-d879f27266fa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1266 microversion: 2.1 time: 0.177743 Sep 01 16:40:09.617587 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 420/808] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:09 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:10.147408 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c4577ce3-b08a-4efa-ab1a-386a73d3cd99 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:10.148289 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c4577ce3-b08a-4efa-ab1a-386a73d3cd99 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:10.155369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c4577ce3-b08a-4efa-ab1a-386a73d3cd99 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.155852 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c4577ce3-b08a-4efa-ab1a-386a73d3cd99 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.156485 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c4577ce3-b08a-4efa-ab1a-386a73d3cd99 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.157407 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c4577ce3-b08a-4efa-ab1a-386a73d3cd99 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.157935 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c4577ce3-b08a-4efa-ab1a-386a73d3cd99 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.158383 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c4577ce3-b08a-4efa-ab1a-386a73d3cd99 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.201269 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-fb3826ba-0a49-4ffc-a507-06f8c2d3967e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:10.202764 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-fb3826ba-0a49-4ffc-a507-06f8c2d3967e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:10.209137 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fb3826ba-0a49-4ffc-a507-06f8c2d3967e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.213160 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fb3826ba-0a49-4ffc-a507-06f8c2d3967e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.213856 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fb3826ba-0a49-4ffc-a507-06f8c2d3967e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.216031 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fb3826ba-0a49-4ffc-a507-06f8c2d3967e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.216736 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fb3826ba-0a49-4ffc-a507-06f8c2d3967e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.217265 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fb3826ba-0a49-4ffc-a507-06f8c2d3967e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.233600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:10.324061 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c4577ce3-b08a-4efa-ab1a-386a73d3cd99 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:10.333338 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c4577ce3-b08a-4efa-ab1a-386a73d3cd99 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1259 microversion: 2.1 time: 0.189550 Sep 01 16:40:10.333920 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 389/809] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:10 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:10.425574 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-fb3826ba-0a49-4ffc-a507-06f8c2d3967e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:10.435526 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-fb3826ba-0a49-4ffc-a507-06f8c2d3967e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:10.437292 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-fb3826ba-0a49-4ffc-a507-06f8c2d3967e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:10.439246 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-fb3826ba-0a49-4ffc-a507-06f8c2d3967e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1740 microversion: 2.20 time: 0.242311 Sep 01 16:40:10.440375 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 421/810] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:10 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:10.639601 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ed8be78c-d1dd-4283-9f0a-b228be13966a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:10.640214 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ed8be78c-d1dd-4283-9f0a-b228be13966a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:10.647924 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed8be78c-d1dd-4283-9f0a-b228be13966a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.648420 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed8be78c-d1dd-4283-9f0a-b228be13966a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.648851 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed8be78c-d1dd-4283-9f0a-b228be13966a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.649545 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed8be78c-d1dd-4283-9f0a-b228be13966a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.649992 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed8be78c-d1dd-4283-9f0a-b228be13966a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.650445 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ed8be78c-d1dd-4283-9f0a-b228be13966a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.842565 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:10.870171 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=8 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:10.910528 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ed8be78c-d1dd-4283-9f0a-b228be13966a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:10.912766 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-d920f7c5-ca3c-43bf-85f2-a654d4a159e7 req-1f2f979d-1264-4ca5-8036-1a23dbe7977b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d764e51-5b8a-4d17-886e-b52189448293", "name": "network-vif-plugged", "status": "completed", "tag": "5bb9e1c4-5809-406a-8024-a9bfe99bb842"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:10.920683 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ed8be78c-d1dd-4283-9f0a-b228be13966a tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1266 microversion: 2.1 time: 0.284887 Sep 01 16:40:10.928204 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 390/811] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:10 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:10.928879 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-d920f7c5-ca3c-43bf-85f2-a654d4a159e7 req-1f2f979d-1264-4ca5-8036-1a23dbe7977b service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.929549 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-d920f7c5-ca3c-43bf-85f2-a654d4a159e7 req-1f2f979d-1264-4ca5-8036-1a23dbe7977b service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.930123 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-d920f7c5-ca3c-43bf-85f2-a654d4a159e7 req-1f2f979d-1264-4ca5-8036-1a23dbe7977b service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.945986 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-d920f7c5-ca3c-43bf-85f2-a654d4a159e7 req-1f2f979d-1264-4ca5-8036-1a23dbe7977b service nova] Creating event network-vif-plugged:5bb9e1c4-5809-406a-8024-a9bfe99bb842 for instance 7d764e51-5b8a-4d17-886e-b52189448293 on hv-cinder-85220 Sep 01 16:40:10.952491 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-d920f7c5-ca3c-43bf-85f2-a654d4a159e7 req-1f2f979d-1264-4ca5-8036-1a23dbe7977b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251338 Sep 01 16:40:10.960499 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 422/812] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:11.355635 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-3757f564-454a-421a-a3c5-3ab35f612b88 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:11.359126 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-3757f564-454a-421a-a3c5-3ab35f612b88 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:11.368160 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3757f564-454a-421a-a3c5-3ab35f612b88 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:11.369900 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3757f564-454a-421a-a3c5-3ab35f612b88 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:11.370454 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3757f564-454a-421a-a3c5-3ab35f612b88 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:11.371909 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3757f564-454a-421a-a3c5-3ab35f612b88 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:11.372628 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3757f564-454a-421a-a3c5-3ab35f612b88 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:11.375177 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3757f564-454a-421a-a3c5-3ab35f612b88 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:11.467032 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=8 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:11.478281 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-96974101-d51c-4777-b9c0-6afed43ea4db tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:11.479385 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-96974101-d51c-4777-b9c0-6afed43ea4db tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:11.487333 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96974101-d51c-4777-b9c0-6afed43ea4db tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:11.488011 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96974101-d51c-4777-b9c0-6afed43ea4db tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:11.488523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96974101-d51c-4777-b9c0-6afed43ea4db tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:11.489419 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96974101-d51c-4777-b9c0-6afed43ea4db tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:11.490334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96974101-d51c-4777-b9c0-6afed43ea4db tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:11.490929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96974101-d51c-4777-b9c0-6afed43ea4db tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:11.576558 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-3757f564-454a-421a-a3c5-3ab35f612b88 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:11.586629 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-3757f564-454a-421a-a3c5-3ab35f612b88 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1259 microversion: 2.1 time: 0.235962 Sep 01 16:40:11.599923 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 391/813] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:11 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1259 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:11.662632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-96974101-d51c-4777-b9c0-6afed43ea4db tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:11.672621 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-96974101-d51c-4777-b9c0-6afed43ea4db tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:11.674451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-96974101-d51c-4777-b9c0-6afed43ea4db tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:11.675942 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-96974101-d51c-4777-b9c0-6afed43ea4db tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1740 microversion: 2.20 time: 0.210810 Sep 01 16:40:11.676972 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 423/814] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:11 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:12.020007 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-0d7fe867-da11-4132-8444-419fa448f848 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:12.020611 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0d7fe867-da11-4132-8444-419fa448f848 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:12.030368 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0d7fe867-da11-4132-8444-419fa448f848 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:12.031053 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0d7fe867-da11-4132-8444-419fa448f848 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:12.031867 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0d7fe867-da11-4132-8444-419fa448f848 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:12.033233 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0d7fe867-da11-4132-8444-419fa448f848 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:12.033878 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0d7fe867-da11-4132-8444-419fa448f848 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:12.036157 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0d7fe867-da11-4132-8444-419fa448f848 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:12.222744 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0d7fe867-da11-4132-8444-419fa448f848 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:12.233575 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-0d7fe867-da11-4132-8444-419fa448f848 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1266 microversion: 2.1 time: 0.217245 Sep 01 16:40:12.234317 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 392/815] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:12 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:12.608309 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5a258691-b2f5-4f37-ad6c-8a8760776efc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:12.609601 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5a258691-b2f5-4f37-ad6c-8a8760776efc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:12.618062 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a258691-b2f5-4f37-ad6c-8a8760776efc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:12.619349 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a258691-b2f5-4f37-ad6c-8a8760776efc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:12.619774 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a258691-b2f5-4f37-ad6c-8a8760776efc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:12.620685 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a258691-b2f5-4f37-ad6c-8a8760776efc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:12.621878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a258691-b2f5-4f37-ad6c-8a8760776efc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:12.622494 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a258691-b2f5-4f37-ad6c-8a8760776efc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:12.700683 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-cec77171-e4f0-4225-9eeb-d9851b20e1e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:12.701497 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-cec77171-e4f0-4225-9eeb-d9851b20e1e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:12.718437 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cec77171-e4f0-4225-9eeb-d9851b20e1e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:12.718948 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cec77171-e4f0-4225-9eeb-d9851b20e1e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:12.719903 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cec77171-e4f0-4225-9eeb-d9851b20e1e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:12.720776 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cec77171-e4f0-4225-9eeb-d9851b20e1e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:12.721334 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cec77171-e4f0-4225-9eeb-d9851b20e1e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:12.721980 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cec77171-e4f0-4225-9eeb-d9851b20e1e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:12.800931 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5a258691-b2f5-4f37-ad6c-8a8760776efc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:12.809935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5a258691-b2f5-4f37-ad6c-8a8760776efc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1259 microversion: 2.1 time: 0.206173 Sep 01 16:40:12.823076 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 424/816] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:12 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:12.911903 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-cec77171-e4f0-4225-9eeb-d9851b20e1e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:12.920754 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-cec77171-e4f0-4225-9eeb-d9851b20e1e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:12.922505 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-cec77171-e4f0-4225-9eeb-d9851b20e1e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:12.923856 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-cec77171-e4f0-4225-9eeb-d9851b20e1e9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1740 microversion: 2.20 time: 0.228166 Sep 01 16:40:12.924759 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 393/817] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:12 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:13.294556 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5eb00494-b82b-4932-ae7f-d4fcb722e73c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:13.294556 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5eb00494-b82b-4932-ae7f-d4fcb722e73c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:13.304260 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eb00494-b82b-4932-ae7f-d4fcb722e73c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:13.304754 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eb00494-b82b-4932-ae7f-d4fcb722e73c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:13.308828 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eb00494-b82b-4932-ae7f-d4fcb722e73c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:13.309570 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eb00494-b82b-4932-ae7f-d4fcb722e73c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:13.310060 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eb00494-b82b-4932-ae7f-d4fcb722e73c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:13.319150 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eb00494-b82b-4932-ae7f-d4fcb722e73c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:13.500666 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5eb00494-b82b-4932-ae7f-d4fcb722e73c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:13.514361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5eb00494-b82b-4932-ae7f-d4fcb722e73c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1266 microversion: 2.1 time: 0.242820 Sep 01 16:40:13.515768 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 425/818] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:13 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:13.831413 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-09161b6a-e1a1-483c-a350-939d24d71f77 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:13.832704 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-09161b6a-e1a1-483c-a350-939d24d71f77 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:13.839814 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09161b6a-e1a1-483c-a350-939d24d71f77 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:13.840290 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09161b6a-e1a1-483c-a350-939d24d71f77 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:13.841434 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09161b6a-e1a1-483c-a350-939d24d71f77 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:13.842366 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09161b6a-e1a1-483c-a350-939d24d71f77 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:13.842967 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09161b6a-e1a1-483c-a350-939d24d71f77 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:13.843540 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-09161b6a-e1a1-483c-a350-939d24d71f77 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:13.948737 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0d1e4b60-fe34-473a-ac21-bb445f616b54 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:13.949994 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0d1e4b60-fe34-473a-ac21-bb445f616b54 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:13.957757 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d1e4b60-fe34-473a-ac21-bb445f616b54 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:13.958261 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d1e4b60-fe34-473a-ac21-bb445f616b54 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:13.958713 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d1e4b60-fe34-473a-ac21-bb445f616b54 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:13.959560 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d1e4b60-fe34-473a-ac21-bb445f616b54 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:13.960016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d1e4b60-fe34-473a-ac21-bb445f616b54 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:13.960434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d1e4b60-fe34-473a-ac21-bb445f616b54 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:14.005160 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-09161b6a-e1a1-483c-a350-939d24d71f77 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:14.019923 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-09161b6a-e1a1-483c-a350-939d24d71f77 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1259 microversion: 2.1 time: 0.192134 Sep 01 16:40:14.034629 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 394/819] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:13 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:14.113817 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0d1e4b60-fe34-473a-ac21-bb445f616b54 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:14.122794 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0d1e4b60-fe34-473a-ac21-bb445f616b54 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:14.124244 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0d1e4b60-fe34-473a-ac21-bb445f616b54 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:14.125412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0d1e4b60-fe34-473a-ac21-bb445f616b54 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1740 microversion: 2.20 time: 0.180737 Sep 01 16:40:14.126038 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 426/820] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:13 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:14.536093 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-584cfae6-c3bb-472b-807d-2f8d970cccc6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:14.536705 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-584cfae6-c3bb-472b-807d-2f8d970cccc6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:14.538655 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:14.548663 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-584cfae6-c3bb-472b-807d-2f8d970cccc6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:14.549503 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-584cfae6-c3bb-472b-807d-2f8d970cccc6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:14.550014 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-584cfae6-c3bb-472b-807d-2f8d970cccc6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:14.554591 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-584cfae6-c3bb-472b-807d-2f8d970cccc6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:14.555395 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-584cfae6-c3bb-472b-807d-2f8d970cccc6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:14.556002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-584cfae6-c3bb-472b-807d-2f8d970cccc6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:14.583473 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9a624290-05c0-461d-8887-c8cf6b4848b3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:14.584594 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9a624290-05c0-461d-8887-c8cf6b4848b3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:14.592170 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a624290-05c0-461d-8887-c8cf6b4848b3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:14.593091 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a624290-05c0-461d-8887-c8cf6b4848b3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:14.594147 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a624290-05c0-461d-8887-c8cf6b4848b3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:14.596316 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a624290-05c0-461d-8887-c8cf6b4848b3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:14.597558 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a624290-05c0-461d-8887-c8cf6b4848b3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:14.598254 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a624290-05c0-461d-8887-c8cf6b4848b3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:14.638060 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9a624290-05c0-461d-8887-c8cf6b4848b3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/ips" status: 200 len: 146 microversion: 2.1 time: 0.058731 Sep 01 16:40:14.642704 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 427/821] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 1 16:40:14 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/ips => generated 146 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:14.832293 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-584cfae6-c3bb-472b-807d-2f8d970cccc6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:14.843720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-584cfae6-c3bb-472b-807d-2f8d970cccc6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1266 microversion: 2.1 time: 0.311707 Sep 01 16:40:14.858531 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 395/822] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:14 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:14.947624 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-af575219-603e-4d80-805e-c9db37ee1803 req-068015d4-421f-4740-a44c-c226cbb59147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad0df24-0b95-4583-9017-6322bebd55a0", "name": "network-vif-plugged", "status": "completed", "tag": "85932ff9-5198-4161-a8d5-3f43070b4618"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:14.965192 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-af575219-603e-4d80-805e-c9db37ee1803 req-068015d4-421f-4740-a44c-c226cbb59147 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:14.971803 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-af575219-603e-4d80-805e-c9db37ee1803 req-068015d4-421f-4740-a44c-c226cbb59147 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:14.972791 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-af575219-603e-4d80-805e-c9db37ee1803 req-068015d4-421f-4740-a44c-c226cbb59147 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:15.018252 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-af575219-603e-4d80-805e-c9db37ee1803 req-068015d4-421f-4740-a44c-c226cbb59147 service nova] Creating event network-vif-plugged:85932ff9-5198-4161-a8d5-3f43070b4618 for instance fad0df24-0b95-4583-9017-6322bebd55a0 on hv-cinder-85220 Sep 01 16:40:15.031563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-af575219-603e-4d80-805e-c9db37ee1803 req-068015d4-421f-4740-a44c-c226cbb59147 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087823 Sep 01 16:40:15.032633 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 428/823] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:15.043712 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6c486e6b-4ca8-45a5-9225-c6c0af79a84f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:15.044332 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-6c486e6b-4ca8-45a5-9225-c6c0af79a84f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:15.065925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6c486e6b-4ca8-45a5-9225-c6c0af79a84f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:15.066634 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6c486e6b-4ca8-45a5-9225-c6c0af79a84f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:15.068193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6c486e6b-4ca8-45a5-9225-c6c0af79a84f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:15.070615 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6c486e6b-4ca8-45a5-9225-c6c0af79a84f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:15.077891 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6c486e6b-4ca8-45a5-9225-c6c0af79a84f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:15.079173 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6c486e6b-4ca8-45a5-9225-c6c0af79a84f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:15.117480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=100 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:15.153655 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c1f0c9ca-5816-4143-8f5e-6713efb205ee tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:15.154490 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c1f0c9ca-5816-4143-8f5e-6713efb205ee tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:15.166462 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c1f0c9ca-5816-4143-8f5e-6713efb205ee tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:15.168442 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c1f0c9ca-5816-4143-8f5e-6713efb205ee tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:15.170866 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c1f0c9ca-5816-4143-8f5e-6713efb205ee tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:15.172995 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c1f0c9ca-5816-4143-8f5e-6713efb205ee tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:15.173871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c1f0c9ca-5816-4143-8f5e-6713efb205ee tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:15.176208 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c1f0c9ca-5816-4143-8f5e-6713efb205ee tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:15.341247 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-6c486e6b-4ca8-45a5-9225-c6c0af79a84f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:15.351949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-6c486e6b-4ca8-45a5-9225-c6c0af79a84f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1259 microversion: 2.1 time: 0.313761 Sep 01 16:40:15.363211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 396/824] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:15 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1259 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:15.376646 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c1f0c9ca-5816-4143-8f5e-6713efb205ee tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:15.388343 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c1f0c9ca-5816-4143-8f5e-6713efb205ee tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:15.390163 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c1f0c9ca-5816-4143-8f5e-6713efb205ee tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:15.391569 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c1f0c9ca-5816-4143-8f5e-6713efb205ee tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1740 microversion: 2.20 time: 0.243783 Sep 01 16:40:15.392150 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 429/825] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:15 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:15.868558 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6064449d-b68c-4b90-b298-ab54aa05aa3c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:15.869756 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-6064449d-b68c-4b90-b298-ab54aa05aa3c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:15.877578 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6064449d-b68c-4b90-b298-ab54aa05aa3c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:15.878486 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6064449d-b68c-4b90-b298-ab54aa05aa3c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:15.878929 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6064449d-b68c-4b90-b298-ab54aa05aa3c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:15.879629 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6064449d-b68c-4b90-b298-ab54aa05aa3c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:15.880242 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6064449d-b68c-4b90-b298-ab54aa05aa3c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:15.880940 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6064449d-b68c-4b90-b298-ab54aa05aa3c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:16.041726 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-6064449d-b68c-4b90-b298-ab54aa05aa3c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:16.050454 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-6064449d-b68c-4b90-b298-ab54aa05aa3c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1266 microversion: 2.1 time: 0.186811 Sep 01 16:40:16.051339 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 397/826] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:15 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:16.288295 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e05cbe13-08e8-462d-892a-2f3fd3b7a5b5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c92dae5-fbc5-4adf-9513-50625a231267"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:16.291771 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e05cbe13-08e8-462d-892a-2f3fd3b7a5b5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:16.298825 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e05cbe13-08e8-462d-892a-2f3fd3b7a5b5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:16.299325 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e05cbe13-08e8-462d-892a-2f3fd3b7a5b5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:16.299758 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e05cbe13-08e8-462d-892a-2f3fd3b7a5b5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:16.300461 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e05cbe13-08e8-462d-892a-2f3fd3b7a5b5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:16.300915 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e05cbe13-08e8-462d-892a-2f3fd3b7a5b5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:16.301339 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e05cbe13-08e8-462d-892a-2f3fd3b7a5b5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:16.374804 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-9c2e4d70-85b9-4374-923b-5ca492cf63c3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:16.375513 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-9c2e4d70-85b9-4374-923b-5ca492cf63c3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:16.389166 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9c2e4d70-85b9-4374-923b-5ca492cf63c3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:16.390049 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9c2e4d70-85b9-4374-923b-5ca492cf63c3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:16.392454 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9c2e4d70-85b9-4374-923b-5ca492cf63c3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:16.397743 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9c2e4d70-85b9-4374-923b-5ca492cf63c3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:16.402812 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9c2e4d70-85b9-4374-923b-5ca492cf63c3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:16.403620 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9c2e4d70-85b9-4374-923b-5ca492cf63c3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:16.560931 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9c2e4d70-85b9-4374-923b-5ca492cf63c3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:16.570887 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-9c2e4d70-85b9-4374-923b-5ca492cf63c3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1259 microversion: 2.1 time: 0.199977 Sep 01 16:40:16.582309 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 398/827] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:16 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1259 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:16.582309 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-9649bb26-6121-43da-bb96-50b7b17f2ebb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:16.582309 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-9649bb26-6121-43da-bb96-50b7b17f2ebb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:16.589383 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9649bb26-6121-43da-bb96-50b7b17f2ebb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:16.589966 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9649bb26-6121-43da-bb96-50b7b17f2ebb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:16.590441 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9649bb26-6121-43da-bb96-50b7b17f2ebb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:16.591141 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9649bb26-6121-43da-bb96-50b7b17f2ebb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:16.591611 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9649bb26-6121-43da-bb96-50b7b17f2ebb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:16.592041 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9649bb26-6121-43da-bb96-50b7b17f2ebb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:16.796044 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9649bb26-6121-43da-bb96-50b7b17f2ebb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:16.806927 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9649bb26-6121-43da-bb96-50b7b17f2ebb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:16.809268 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9649bb26-6121-43da-bb96-50b7b17f2ebb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:16.810729 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-9649bb26-6121-43da-bb96-50b7b17f2ebb tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1740 microversion: 2.20 time: 0.237051 Sep 01 16:40:16.823651 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 399/828] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:16 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:17.059121 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-91535dbe-4f89-483c-b131-1ef06f69954e req-26a8e454-ef17-45d7-86de-00f5b96fb737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec8a5228-091c-490d-8790-3cd53e77b5d1", "name": "network-vif-plugged", "status": "completed", "tag": "086e5891-69d8-40bc-9506-7d948bca1db9"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:17.107071 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-91535dbe-4f89-483c-b131-1ef06f69954e req-26a8e454-ef17-45d7-86de-00f5b96fb737 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:17.107794 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-91535dbe-4f89-483c-b131-1ef06f69954e req-26a8e454-ef17-45d7-86de-00f5b96fb737 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:17.108400 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-91535dbe-4f89-483c-b131-1ef06f69954e req-26a8e454-ef17-45d7-86de-00f5b96fb737 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:17.158054 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-91535dbe-4f89-483c-b131-1ef06f69954e req-26a8e454-ef17-45d7-86de-00f5b96fb737 service nova] Creating event network-vif-plugged:086e5891-69d8-40bc-9506-7d948bca1db9 for instance ec8a5228-091c-490d-8790-3cd53e77b5d1 on hv-cinder-85220 Sep 01 16:40:17.169116 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-91535dbe-4f89-483c-b131-1ef06f69954e req-26a8e454-ef17-45d7-86de-00f5b96fb737 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114710 Sep 01 16:40:17.173287 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 400/829] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:17.178953 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-4b9711fe-9f04-483f-a661-3834ef7e7b07 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:17.186042 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-4b9711fe-9f04-483f-a661-3834ef7e7b07 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:17.198548 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4b9711fe-9f04-483f-a661-3834ef7e7b07 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:17.201367 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4b9711fe-9f04-483f-a661-3834ef7e7b07 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:17.201795 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4b9711fe-9f04-483f-a661-3834ef7e7b07 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:17.204787 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4b9711fe-9f04-483f-a661-3834ef7e7b07 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:17.205241 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4b9711fe-9f04-483f-a661-3834ef7e7b07 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:17.205664 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4b9711fe-9f04-483f-a661-3834ef7e7b07 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:17.348467 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e05cbe13-08e8-462d-892a-2f3fd3b7a5b5 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "POST /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.063816 Sep 01 16:40:17.349773 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 430/830] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 1 16:40:16 2022] POST /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments => generated 194 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:17.466536 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-4b9711fe-9f04-483f-a661-3834ef7e7b07 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:17.490898 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-4b9711fe-9f04-483f-a661-3834ef7e7b07 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1266 microversion: 2.1 time: 0.315661 Sep 01 16:40:17.492005 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 401/831] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:17 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1266 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:17.598002 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-887ea538-b647-4a04-82dc-359c908566e8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:17.599649 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-887ea538-b647-4a04-82dc-359c908566e8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:17.604485 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:17.616093 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-887ea538-b647-4a04-82dc-359c908566e8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:17.619609 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-887ea538-b647-4a04-82dc-359c908566e8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:17.620291 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-887ea538-b647-4a04-82dc-359c908566e8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:17.621389 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-887ea538-b647-4a04-82dc-359c908566e8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:17.622057 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-887ea538-b647-4a04-82dc-359c908566e8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:17.622346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-887ea538-b647-4a04-82dc-359c908566e8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:17.811761 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-887ea538-b647-4a04-82dc-359c908566e8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:17.820876 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-887ea538-b647-4a04-82dc-359c908566e8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1442 microversion: 2.1 time: 0.228812 Sep 01 16:40:17.830785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 431/832] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:17 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1442 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:17.841600 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-12f7bddf-eac7-418c-8f73-2577c6dc6fa2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:17.842206 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-12f7bddf-eac7-418c-8f73-2577c6dc6fa2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:17.852285 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-12f7bddf-eac7-418c-8f73-2577c6dc6fa2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:17.852772 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-12f7bddf-eac7-418c-8f73-2577c6dc6fa2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:17.853196 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-12f7bddf-eac7-418c-8f73-2577c6dc6fa2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:17.853883 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-12f7bddf-eac7-418c-8f73-2577c6dc6fa2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:17.854357 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-12f7bddf-eac7-418c-8f73-2577c6dc6fa2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:17.854775 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-12f7bddf-eac7-418c-8f73-2577c6dc6fa2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:17.857571 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0157b524-c738-4144-85fb-f32a267c983d tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:17.858602 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0157b524-c738-4144-85fb-f32a267c983d tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:17.869156 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0157b524-c738-4144-85fb-f32a267c983d tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:17.870226 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0157b524-c738-4144-85fb-f32a267c983d tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:17.871682 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0157b524-c738-4144-85fb-f32a267c983d tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:17.872573 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0157b524-c738-4144-85fb-f32a267c983d tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:17.873229 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0157b524-c738-4144-85fb-f32a267c983d tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:17.873848 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0157b524-c738-4144-85fb-f32a267c983d tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:18.030828 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-12f7bddf-eac7-418c-8f73-2577c6dc6fa2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:18.040004 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-12f7bddf-eac7-418c-8f73-2577c6dc6fa2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:18.041873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-12f7bddf-eac7-418c-8f73-2577c6dc6fa2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:18.043300 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-12f7bddf-eac7-418c-8f73-2577c6dc6fa2 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1740 microversion: 2.20 time: 0.212991 Sep 01 16:40:18.059694 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 402/833] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:17 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:18.129221 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0157b524-c738-4144-85fb-f32a267c983d tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:18.146263 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0157b524-c738-4144-85fb-f32a267c983d tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1442 microversion: 2.1 time: 0.300049 Sep 01 16:40:18.150364 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 432/834] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:17 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1442 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:18.517978 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-89750da9-a27e-48ea-942c-24c21180c744 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:18.518615 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-89750da9-a27e-48ea-942c-24c21180c744 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:18.529957 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-89750da9-a27e-48ea-942c-24c21180c744 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:18.531087 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-89750da9-a27e-48ea-942c-24c21180c744 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:18.531863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-89750da9-a27e-48ea-942c-24c21180c744 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:18.532791 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-89750da9-a27e-48ea-942c-24c21180c744 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:18.533392 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-89750da9-a27e-48ea-942c-24c21180c744 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:18.534143 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-89750da9-a27e-48ea-942c-24c21180c744 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:18.963665 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-89750da9-a27e-48ea-942c-24c21180c744 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:18.978151 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-89750da9-a27e-48ea-942c-24c21180c744 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1266 microversion: 2.1 time: 0.465961 Sep 01 16:40:18.978779 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 403/835] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:18 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1266 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:19.067769 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4f45205f-5597-4c21-8bc6-b5a41b2d388c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:19.069326 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4f45205f-5597-4c21-8bc6-b5a41b2d388c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:19.080259 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f45205f-5597-4c21-8bc6-b5a41b2d388c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:19.081044 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f45205f-5597-4c21-8bc6-b5a41b2d388c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:19.081625 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f45205f-5597-4c21-8bc6-b5a41b2d388c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:19.082497 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f45205f-5597-4c21-8bc6-b5a41b2d388c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:19.083095 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f45205f-5597-4c21-8bc6-b5a41b2d388c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:19.083920 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f45205f-5597-4c21-8bc6-b5a41b2d388c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:19.433081 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4f45205f-5597-4c21-8bc6-b5a41b2d388c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:19.443319 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4f45205f-5597-4c21-8bc6-b5a41b2d388c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:19.447375 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4f45205f-5597-4c21-8bc6-b5a41b2d388c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:19.450481 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4f45205f-5597-4c21-8bc6-b5a41b2d388c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1740 microversion: 2.20 time: 0.387380 Sep 01 16:40:19.452074 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 433/836] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:19 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1740 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:20.002580 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-9faa000f-59ce-42ec-b5f5-916c5249c791 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:20.003192 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-9faa000f-59ce-42ec-b5f5-916c5249c791 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:20.015336 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9faa000f-59ce-42ec-b5f5-916c5249c791 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.016918 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9faa000f-59ce-42ec-b5f5-916c5249c791 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.018533 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9faa000f-59ce-42ec-b5f5-916c5249c791 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.019612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9faa000f-59ce-42ec-b5f5-916c5249c791 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.020308 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9faa000f-59ce-42ec-b5f5-916c5249c791 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.020970 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9faa000f-59ce-42ec-b5f5-916c5249c791 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.285736 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-9faa000f-59ce-42ec-b5f5-916c5249c791 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:20.294850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-9faa000f-59ce-42ec-b5f5-916c5249c791 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1452 microversion: 2.1 time: 0.296600 Sep 01 16:40:20.310633 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 404/837] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:19 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1452 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:20.315174 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-562d492d-de7a-462e-bc3b-20e18b288e0f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:20.315602 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-562d492d-de7a-462e-bc3b-20e18b288e0f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:20.327144 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-562d492d-de7a-462e-bc3b-20e18b288e0f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.328322 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-562d492d-de7a-462e-bc3b-20e18b288e0f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.328948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-562d492d-de7a-462e-bc3b-20e18b288e0f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.330003 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-562d492d-de7a-462e-bc3b-20e18b288e0f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.340622 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-562d492d-de7a-462e-bc3b-20e18b288e0f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.341309 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-562d492d-de7a-462e-bc3b-20e18b288e0f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.477057 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-0b88e024-ee2d-4c3a-84be-74b619dbff2b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:20.477924 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0b88e024-ee2d-4c3a-84be-74b619dbff2b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:20.493823 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0b88e024-ee2d-4c3a-84be-74b619dbff2b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.494760 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0b88e024-ee2d-4c3a-84be-74b619dbff2b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.495405 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0b88e024-ee2d-4c3a-84be-74b619dbff2b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.496413 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0b88e024-ee2d-4c3a-84be-74b619dbff2b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.497069 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0b88e024-ee2d-4c3a-84be-74b619dbff2b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.497694 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0b88e024-ee2d-4c3a-84be-74b619dbff2b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.521906 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-562d492d-de7a-462e-bc3b-20e18b288e0f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:20.533396 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-562d492d-de7a-462e-bc3b-20e18b288e0f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1452 microversion: 2.1 time: 0.221079 Sep 01 16:40:20.536351 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 434/838] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:20 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1452 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:20.797271 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0b88e024-ee2d-4c3a-84be-74b619dbff2b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:20.809032 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0b88e024-ee2d-4c3a-84be-74b619dbff2b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:20.810949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0b88e024-ee2d-4c3a-84be-74b619dbff2b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:20.812555 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-0b88e024-ee2d-4c3a-84be-74b619dbff2b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1740 microversion: 2.20 time: 0.339339 Sep 01 16:40:20.828309 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 405/839] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:20 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1740 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:21.187456 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-c471a279-bf11-4500-833a-af5e6efd12ad req-f7ec2839-763f-4a0d-8d97-b629d2c634ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad0df24-0b95-4583-9017-6322bebd55a0", "tag": "85932ff9-5198-4161-a8d5-3f43070b4618"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:21.202728 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-c471a279-bf11-4500-833a-af5e6efd12ad req-f7ec2839-763f-4a0d-8d97-b629d2c634ed service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:21.207400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-c471a279-bf11-4500-833a-af5e6efd12ad req-f7ec2839-763f-4a0d-8d97-b629d2c634ed service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:21.207987 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-c471a279-bf11-4500-833a-af5e6efd12ad req-f7ec2839-763f-4a0d-8d97-b629d2c634ed service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:21.233231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-c471a279-bf11-4500-833a-af5e6efd12ad req-f7ec2839-763f-4a0d-8d97-b629d2c634ed service nova] Creating event network-changed:85932ff9-5198-4161-a8d5-3f43070b4618 for instance fad0df24-0b95-4583-9017-6322bebd55a0 on hv-cinder-85220 Sep 01 16:40:21.239028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-c471a279-bf11-4500-833a-af5e6efd12ad req-f7ec2839-763f-4a0d-8d97-b629d2c634ed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056208 Sep 01 16:40:21.240144 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 435/840] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:21.844276 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e0497780-ab4b-4c49-a1d6-748699a5baf5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:21.845591 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-e0497780-ab4b-4c49-a1d6-748699a5baf5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:21.853752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e0497780-ab4b-4c49-a1d6-748699a5baf5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:21.854564 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e0497780-ab4b-4c49-a1d6-748699a5baf5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:21.855404 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e0497780-ab4b-4c49-a1d6-748699a5baf5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:21.857044 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e0497780-ab4b-4c49-a1d6-748699a5baf5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:21.857693 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e0497780-ab4b-4c49-a1d6-748699a5baf5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:21.858313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e0497780-ab4b-4c49-a1d6-748699a5baf5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:22.020067 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e0497780-ab4b-4c49-a1d6-748699a5baf5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:22.029327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e0497780-ab4b-4c49-a1d6-748699a5baf5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:22.030817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-e0497780-ab4b-4c49-a1d6-748699a5baf5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:22.032107 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-e0497780-ab4b-4c49-a1d6-748699a5baf5 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1740 microversion: 2.20 time: 0.192225 Sep 01 16:40:22.033167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 406/841] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:21 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:23.055793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-4671fde0-6d1f-449c-acf0-1579a66d5dfe tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:23.056525 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-4671fde0-6d1f-449c-acf0-1579a66d5dfe tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:23.057341 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-28b45e97-ae57-4ae8-8806-19cb80c01f89 req-862b6502-5ed8-4e06-83c9-6fa5317071a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec8a5228-091c-490d-8790-3cd53e77b5d1", "tag": "086e5891-69d8-40bc-9506-7d948bca1db9"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:23.064507 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4671fde0-6d1f-449c-acf0-1579a66d5dfe tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:23.065296 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4671fde0-6d1f-449c-acf0-1579a66d5dfe tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:23.065977 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4671fde0-6d1f-449c-acf0-1579a66d5dfe tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:23.067010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4671fde0-6d1f-449c-acf0-1579a66d5dfe tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:23.067683 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4671fde0-6d1f-449c-acf0-1579a66d5dfe tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:23.068321 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4671fde0-6d1f-449c-acf0-1579a66d5dfe tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:23.068719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-28b45e97-ae57-4ae8-8806-19cb80c01f89 req-862b6502-5ed8-4e06-83c9-6fa5317071a8 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:23.069367 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-28b45e97-ae57-4ae8-8806-19cb80c01f89 req-862b6502-5ed8-4e06-83c9-6fa5317071a8 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:23.069963 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-28b45e97-ae57-4ae8-8806-19cb80c01f89 req-862b6502-5ed8-4e06-83c9-6fa5317071a8 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:23.083777 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-28b45e97-ae57-4ae8-8806-19cb80c01f89 req-862b6502-5ed8-4e06-83c9-6fa5317071a8 service nova] Creating event network-changed:086e5891-69d8-40bc-9506-7d948bca1db9 for instance ec8a5228-091c-490d-8790-3cd53e77b5d1 on hv-cinder-85220 Sep 01 16:40:23.088833 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-28b45e97-ae57-4ae8-8806-19cb80c01f89 req-862b6502-5ed8-4e06-83c9-6fa5317071a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199993 Sep 01 16:40:23.090581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 436/842] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:23.327538 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-4671fde0-6d1f-449c-acf0-1579a66d5dfe tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:23.336071 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-4671fde0-6d1f-449c-acf0-1579a66d5dfe tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:23.337658 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-4671fde0-6d1f-449c-acf0-1579a66d5dfe tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:23.339019 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-4671fde0-6d1f-449c-acf0-1579a66d5dfe tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1722 microversion: 2.20 time: 0.287147 Sep 01 16:40:23.339868 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 407/843] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:23 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:24.365242 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b5b48542-66f1-49af-a9df-97d8b2dc7980 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:24.366172 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b5b48542-66f1-49af-a9df-97d8b2dc7980 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:24.374374 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5b48542-66f1-49af-a9df-97d8b2dc7980 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:24.374856 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5b48542-66f1-49af-a9df-97d8b2dc7980 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:24.375313 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5b48542-66f1-49af-a9df-97d8b2dc7980 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:24.376032 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5b48542-66f1-49af-a9df-97d8b2dc7980 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:24.376478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5b48542-66f1-49af-a9df-97d8b2dc7980 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:24.376890 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5b48542-66f1-49af-a9df-97d8b2dc7980 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:24.511796 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b5b48542-66f1-49af-a9df-97d8b2dc7980 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:24.520671 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b5b48542-66f1-49af-a9df-97d8b2dc7980 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:24.522346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b5b48542-66f1-49af-a9df-97d8b2dc7980 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:24.523504 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b5b48542-66f1-49af-a9df-97d8b2dc7980 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1722 microversion: 2.20 time: 0.162575 Sep 01 16:40:24.524052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 437/844] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:24 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:25.549277 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-50365da6-9280-40e5-a188-1f52a5f836e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:25.550143 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-50365da6-9280-40e5-a188-1f52a5f836e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:25.557301 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-50365da6-9280-40e5-a188-1f52a5f836e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:25.557788 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-50365da6-9280-40e5-a188-1f52a5f836e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:25.558226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-50365da6-9280-40e5-a188-1f52a5f836e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:25.559054 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-50365da6-9280-40e5-a188-1f52a5f836e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:25.559385 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-50365da6-9280-40e5-a188-1f52a5f836e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:25.559808 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-50365da6-9280-40e5-a188-1f52a5f836e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:25.782727 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-50365da6-9280-40e5-a188-1f52a5f836e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:25.793652 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-50365da6-9280-40e5-a188-1f52a5f836e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:25.798430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-50365da6-9280-40e5-a188-1f52a5f836e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:25.799843 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-50365da6-9280-40e5-a188-1f52a5f836e8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1725 microversion: 2.20 time: 0.256370 Sep 01 16:40:25.800571 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 408/845] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:25 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:25.827046 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e35ce050-d71c-42a6-9367-747024112193 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b315aa2a-2167-4ee2-9df0-4dbacf1415c9"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:25.829982 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e35ce050-d71c-42a6-9367-747024112193 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:25.838361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e35ce050-d71c-42a6-9367-747024112193 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:25.839131 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e35ce050-d71c-42a6-9367-747024112193 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:25.839823 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e35ce050-d71c-42a6-9367-747024112193 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:25.840589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e35ce050-d71c-42a6-9367-747024112193 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:25.841108 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e35ce050-d71c-42a6-9367-747024112193 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:25.841526 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e35ce050-d71c-42a6-9367-747024112193 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.050587 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:26.151643 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e35ce050-d71c-42a6-9367-747024112193 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "POST /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.330718 Sep 01 16:40:26.152207 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 438/846] 10.222.0.18 () {62 vars in 1364 bytes} [Thu Sep 1 16:40:25 2022] POST /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293/os-volume_attachments => generated 188 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:40:26.279345 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ee48d00b-5588-4ed7-906f-c7e917cbbf0f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:26.280030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ee48d00b-5588-4ed7-906f-c7e917cbbf0f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:26.285910 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee48d00b-5588-4ed7-906f-c7e917cbbf0f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:26.286418 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee48d00b-5588-4ed7-906f-c7e917cbbf0f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:26.286850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee48d00b-5588-4ed7-906f-c7e917cbbf0f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.287611 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee48d00b-5588-4ed7-906f-c7e917cbbf0f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:26.288060 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee48d00b-5588-4ed7-906f-c7e917cbbf0f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:26.288472 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ee48d00b-5588-4ed7-906f-c7e917cbbf0f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.292292 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1c4decba-fcc9-4e94-b196-6d7cc1370892 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:26.295088 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1c4decba-fcc9-4e94-b196-6d7cc1370892 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:26.301669 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c4decba-fcc9-4e94-b196-6d7cc1370892 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:26.302154 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c4decba-fcc9-4e94-b196-6d7cc1370892 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:26.302610 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c4decba-fcc9-4e94-b196-6d7cc1370892 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.303300 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c4decba-fcc9-4e94-b196-6d7cc1370892 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:26.303749 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c4decba-fcc9-4e94-b196-6d7cc1370892 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:26.304168 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c4decba-fcc9-4e94-b196-6d7cc1370892 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.335900 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1c4decba-fcc9-4e94-b196-6d7cc1370892 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047441 Sep 01 16:40:26.337050 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 439/847] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:40:26 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:26.349503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e0a82250-e747-41f3-b1e0-6710fa6b6461 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:26.350918 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e0a82250-e747-41f3-b1e0-6710fa6b6461 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:26.358705 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e0a82250-e747-41f3-b1e0-6710fa6b6461 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:26.359334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e0a82250-e747-41f3-b1e0-6710fa6b6461 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:26.360235 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e0a82250-e747-41f3-b1e0-6710fa6b6461 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.360452 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e0a82250-e747-41f3-b1e0-6710fa6b6461 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:26.360931 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e0a82250-e747-41f3-b1e0-6710fa6b6461 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:26.361343 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e0a82250-e747-41f3-b1e0-6710fa6b6461 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.393698 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e0a82250-e747-41f3-b1e0-6710fa6b6461 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments/3c92dae5-fbc5-4adf-9513-50625a231267" status: 200 len: 194 microversion: 2.1 time: 0.049562 Sep 01 16:40:26.394313 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 440/848] 10.222.0.18 () {58 vars in 1413 bytes} [Thu Sep 1 16:40:26 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments/3c92dae5-fbc5-4adf-9513-50625a231267 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:26.559344 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ee48d00b-5588-4ed7-906f-c7e917cbbf0f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293/os-volume_attachments/b315aa2a-2167-4ee2-9df0-4dbacf1415c9" status: 202 len: 0 microversion: 2.20 time: 0.284750 Sep 01 16:40:26.560292 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 409/849] 10.222.0.18 () {60 vars in 1457 bytes} [Thu Sep 1 16:40:26 2022] DELETE /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293/os-volume_attachments/b315aa2a-2167-4ee2-9df0-4dbacf1415c9 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 16:40:26.628438 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-776a1f51-2669-4a31-b567-111080c1476b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:26.629037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-776a1f51-2669-4a31-b567-111080c1476b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:26.635828 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-776a1f51-2669-4a31-b567-111080c1476b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:26.636340 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-776a1f51-2669-4a31-b567-111080c1476b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:26.636760 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-776a1f51-2669-4a31-b567-111080c1476b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.637444 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-776a1f51-2669-4a31-b567-111080c1476b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:26.637888 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-776a1f51-2669-4a31-b567-111080c1476b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:26.638324 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-776a1f51-2669-4a31-b567-111080c1476b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.682886 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-776a1f51-2669-4a31-b567-111080c1476b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127177) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 16:40:26.752507 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-776a1f51-2669-4a31-b567-111080c1476b tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "POST /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293/action" status: 202 len: 0 microversion: 2.20 time: 0.128760 Sep 01 16:40:26.753105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 441/850] 10.222.0.18 () {62 vars in 1319 bytes} [Thu Sep 1 16:40:26 2022] POST /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:40:26.761769 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-51d20702-f9de-42d7-af3e-7c2a6db530b6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:26.762666 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-51d20702-f9de-42d7-af3e-7c2a6db530b6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:26.769890 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-51d20702-f9de-42d7-af3e-7c2a6db530b6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:26.770912 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-51d20702-f9de-42d7-af3e-7c2a6db530b6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:26.770912 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-51d20702-f9de-42d7-af3e-7c2a6db530b6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.771718 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-51d20702-f9de-42d7-af3e-7c2a6db530b6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:26.772476 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-51d20702-f9de-42d7-af3e-7c2a6db530b6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:26.772975 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-51d20702-f9de-42d7-af3e-7c2a6db530b6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.843571 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-fd3d9575-326a-4fbc-aa31-d15af0e230da req-0f872b4e-d381-4d74-a70e-d16baaf18cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d764e51-5b8a-4d17-886e-b52189448293", "name": "network-vif-unplugged", "status": "completed", "tag": "5bb9e1c4-5809-406a-8024-a9bfe99bb842"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:26.855130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-fd3d9575-326a-4fbc-aa31-d15af0e230da req-0f872b4e-d381-4d74-a70e-d16baaf18cd6 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:26.855813 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-fd3d9575-326a-4fbc-aa31-d15af0e230da req-0f872b4e-d381-4d74-a70e-d16baaf18cd6 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:26.856401 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-fd3d9575-326a-4fbc-aa31-d15af0e230da req-0f872b4e-d381-4d74-a70e-d16baaf18cd6 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.871413 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.compute.server_external_events [req-fd3d9575-326a-4fbc-aa31-d15af0e230da req-0f872b4e-d381-4d74-a70e-d16baaf18cd6 service nova] Unable to find a host for instance 7d764e51-5b8a-4d17-886e-b52189448293. Dropping event network-vif-unplugged {{(pid=127177) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 01 16:40:26.872371 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-fd3d9575-326a-4fbc-aa31-d15af0e230da req-0f872b4e-d381-4d74-a70e-d16baaf18cd6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033365 Sep 01 16:40:26.873279 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 442/851] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 01 16:40:26.928599 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-51d20702-f9de-42d7-af3e-7c2a6db530b6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:26.937637 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-51d20702-f9de-42d7-af3e-7c2a6db530b6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:26.939179 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-51d20702-f9de-42d7-af3e-7c2a6db530b6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:26.940724 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-51d20702-f9de-42d7-af3e-7c2a6db530b6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1673 microversion: 2.20 time: 0.183276 Sep 01 16:40:26.941442 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 410/852] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:26 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:27.733287 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6f2bb761-5904-45c6-af04-60f60bbb35eb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7772096-914f-4f70-87f9-dab662bc544d"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:27.735607 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6f2bb761-5904-45c6-af04-60f60bbb35eb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:27.741580 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f2bb761-5904-45c6-af04-60f60bbb35eb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.742058 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f2bb761-5904-45c6-af04-60f60bbb35eb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.742529 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f2bb761-5904-45c6-af04-60f60bbb35eb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.743214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f2bb761-5904-45c6-af04-60f60bbb35eb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.743663 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f2bb761-5904-45c6-af04-60f60bbb35eb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.744081 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f2bb761-5904-45c6-af04-60f60bbb35eb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.964526 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-313e7bbe-1521-4d8d-88c6-6a29fb240a5c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:27.965066 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-313e7bbe-1521-4d8d-88c6-6a29fb240a5c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:27.971432 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-313e7bbe-1521-4d8d-88c6-6a29fb240a5c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.972165 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-313e7bbe-1521-4d8d-88c6-6a29fb240a5c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.972609 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-313e7bbe-1521-4d8d-88c6-6a29fb240a5c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.973272 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-313e7bbe-1521-4d8d-88c6-6a29fb240a5c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.973710 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-313e7bbe-1521-4d8d-88c6-6a29fb240a5c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.974121 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-313e7bbe-1521-4d8d-88c6-6a29fb240a5c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.978257 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:28.135015 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6f2bb761-5904-45c6-af04-60f60bbb35eb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "POST /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.405914 Sep 01 16:40:28.135603 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 443/853] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 1 16:40:27 2022] POST /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:28.165694 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-313e7bbe-1521-4d8d-88c6-6a29fb240a5c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:28.174758 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-313e7bbe-1521-4d8d-88c6-6a29fb240a5c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:28.176325 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-313e7bbe-1521-4d8d-88c6-6a29fb240a5c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:28.177703 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-313e7bbe-1521-4d8d-88c6-6a29fb240a5c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 0.217613 Sep 01 16:40:28.178687 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 411/854] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:27 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:29.212710 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ffc5d639-fd80-4a2a-b03f-58e7678368d9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:29.214683 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ffc5d639-fd80-4a2a-b03f-58e7678368d9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:29.236334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ffc5d639-fd80-4a2a-b03f-58e7678368d9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.237217 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ffc5d639-fd80-4a2a-b03f-58e7678368d9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.237806 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ffc5d639-fd80-4a2a-b03f-58e7678368d9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.238590 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ffc5d639-fd80-4a2a-b03f-58e7678368d9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.239037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ffc5d639-fd80-4a2a-b03f-58e7678368d9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.239457 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ffc5d639-fd80-4a2a-b03f-58e7678368d9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.520423 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ffc5d639-fd80-4a2a-b03f-58e7678368d9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:29.532872 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ffc5d639-fd80-4a2a-b03f-58e7678368d9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:29.534859 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ffc5d639-fd80-4a2a-b03f-58e7678368d9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:29.536423 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ffc5d639-fd80-4a2a-b03f-58e7678368d9 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 0.339299 Sep 01 16:40:29.537914 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 444/855] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:29 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:30.561279 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-540cc46c-f8dd-491a-9295-df74121cbe00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:30.561910 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-540cc46c-f8dd-491a-9295-df74121cbe00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:30.570390 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-540cc46c-f8dd-491a-9295-df74121cbe00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.571005 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-540cc46c-f8dd-491a-9295-df74121cbe00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.571531 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-540cc46c-f8dd-491a-9295-df74121cbe00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:30.572268 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-540cc46c-f8dd-491a-9295-df74121cbe00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.572754 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-540cc46c-f8dd-491a-9295-df74121cbe00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.573291 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-540cc46c-f8dd-491a-9295-df74121cbe00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:30.760105 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-540cc46c-f8dd-491a-9295-df74121cbe00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:30.770444 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-540cc46c-f8dd-491a-9295-df74121cbe00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:30.771734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-540cc46c-f8dd-491a-9295-df74121cbe00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:30.772893 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-540cc46c-f8dd-491a-9295-df74121cbe00 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 0.216148 Sep 01 16:40:30.773440 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 412/856] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:30 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:31.797668 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1d021b91-43dc-4976-8f2f-66c16171da95 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:31.798295 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1d021b91-43dc-4976-8f2f-66c16171da95 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:31.804507 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d021b91-43dc-4976-8f2f-66c16171da95 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:31.805013 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d021b91-43dc-4976-8f2f-66c16171da95 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:31.805447 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d021b91-43dc-4976-8f2f-66c16171da95 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:31.806135 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d021b91-43dc-4976-8f2f-66c16171da95 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:31.806617 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d021b91-43dc-4976-8f2f-66c16171da95 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:31.807065 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d021b91-43dc-4976-8f2f-66c16171da95 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:31.952401 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1d021b91-43dc-4976-8f2f-66c16171da95 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:31.960603 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1d021b91-43dc-4976-8f2f-66c16171da95 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:31.962036 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1d021b91-43dc-4976-8f2f-66c16171da95 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:31.963245 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1d021b91-43dc-4976-8f2f-66c16171da95 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 0.169554 Sep 01 16:40:31.963801 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 445/857] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:31 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:32.988519 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-eec35aca-ffc6-4d98-9ee4-1bc6ce22905f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:32.989282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-eec35aca-ffc6-4d98-9ee4-1bc6ce22905f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:32.997156 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eec35aca-ffc6-4d98-9ee4-1bc6ce22905f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:32.997784 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eec35aca-ffc6-4d98-9ee4-1bc6ce22905f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:32.998387 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eec35aca-ffc6-4d98-9ee4-1bc6ce22905f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:32.999219 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eec35aca-ffc6-4d98-9ee4-1bc6ce22905f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:32.999794 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eec35aca-ffc6-4d98-9ee4-1bc6ce22905f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:33.000279 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eec35aca-ffc6-4d98-9ee4-1bc6ce22905f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:33.137068 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-eec35aca-ffc6-4d98-9ee4-1bc6ce22905f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:33.147644 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-eec35aca-ffc6-4d98-9ee4-1bc6ce22905f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:33.149399 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-eec35aca-ffc6-4d98-9ee4-1bc6ce22905f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:33.150629 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-eec35aca-ffc6-4d98-9ee4-1bc6ce22905f tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 0.167186 Sep 01 16:40:33.151199 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 413/858] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:32 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:34.174611 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bf708a18-93ab-4ad1-b79c-91df0c7d6487 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:34.175274 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bf708a18-93ab-4ad1-b79c-91df0c7d6487 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:34.182078 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf708a18-93ab-4ad1-b79c-91df0c7d6487 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:34.182583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf708a18-93ab-4ad1-b79c-91df0c7d6487 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:34.183270 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf708a18-93ab-4ad1-b79c-91df0c7d6487 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:34.183961 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf708a18-93ab-4ad1-b79c-91df0c7d6487 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:34.184463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf708a18-93ab-4ad1-b79c-91df0c7d6487 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:34.184879 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf708a18-93ab-4ad1-b79c-91df0c7d6487 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:34.325443 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bf708a18-93ab-4ad1-b79c-91df0c7d6487 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:34.333841 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bf708a18-93ab-4ad1-b79c-91df0c7d6487 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:34.335294 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bf708a18-93ab-4ad1-b79c-91df0c7d6487 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:34.336450 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bf708a18-93ab-4ad1-b79c-91df0c7d6487 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 0.166750 Sep 01 16:40:34.337008 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 446/859] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:34 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:35.360942 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a7911190-7014-4dc9-b944-62199cbda1bc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:35.361852 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a7911190-7014-4dc9-b944-62199cbda1bc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:35.368402 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a7911190-7014-4dc9-b944-62199cbda1bc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:35.368879 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a7911190-7014-4dc9-b944-62199cbda1bc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:35.369306 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a7911190-7014-4dc9-b944-62199cbda1bc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:35.369998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a7911190-7014-4dc9-b944-62199cbda1bc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:35.371016 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a7911190-7014-4dc9-b944-62199cbda1bc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:35.371435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a7911190-7014-4dc9-b944-62199cbda1bc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:35.512152 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a7911190-7014-4dc9-b944-62199cbda1bc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:35.520467 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a7911190-7014-4dc9-b944-62199cbda1bc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:35.521921 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a7911190-7014-4dc9-b944-62199cbda1bc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:35.523126 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a7911190-7014-4dc9-b944-62199cbda1bc tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 0.166274 Sep 01 16:40:35.523681 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 414/860] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:35 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:36.550185 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4254eb99-18df-4ae3-b41e-b5d06956c1f6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:36.552579 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4254eb99-18df-4ae3-b41e-b5d06956c1f6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:36.563541 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4254eb99-18df-4ae3-b41e-b5d06956c1f6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:36.564052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4254eb99-18df-4ae3-b41e-b5d06956c1f6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:36.564501 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4254eb99-18df-4ae3-b41e-b5d06956c1f6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:36.565261 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4254eb99-18df-4ae3-b41e-b5d06956c1f6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:36.565708 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4254eb99-18df-4ae3-b41e-b5d06956c1f6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:36.566144 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4254eb99-18df-4ae3-b41e-b5d06956c1f6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:36.706606 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4254eb99-18df-4ae3-b41e-b5d06956c1f6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:36.716045 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4254eb99-18df-4ae3-b41e-b5d06956c1f6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:36.718812 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4254eb99-18df-4ae3-b41e-b5d06956c1f6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:36.720025 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4254eb99-18df-4ae3-b41e-b5d06956c1f6 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 0.176500 Sep 01 16:40:36.721029 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 447/861] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:36 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:37.745200 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-432ec4ff-e464-4459-bab7-bc376903897c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:37.747227 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-432ec4ff-e464-4459-bab7-bc376903897c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:37.756133 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-432ec4ff-e464-4459-bab7-bc376903897c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:37.756905 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-432ec4ff-e464-4459-bab7-bc376903897c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:37.757950 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-432ec4ff-e464-4459-bab7-bc376903897c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:37.759103 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-432ec4ff-e464-4459-bab7-bc376903897c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:37.759920 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-432ec4ff-e464-4459-bab7-bc376903897c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:37.760523 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-432ec4ff-e464-4459-bab7-bc376903897c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:37.916129 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-432ec4ff-e464-4459-bab7-bc376903897c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:37.924999 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-432ec4ff-e464-4459-bab7-bc376903897c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:37.926375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-432ec4ff-e464-4459-bab7-bc376903897c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:37.927514 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-432ec4ff-e464-4459-bab7-bc376903897c tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 0.186264 Sep 01 16:40:37.928072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 415/862] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:37 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:38.951032 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-79db0898-d30d-4f93-9497-1b2281456463 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:38.951635 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-79db0898-d30d-4f93-9497-1b2281456463 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:38.958058 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79db0898-d30d-4f93-9497-1b2281456463 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:38.958564 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79db0898-d30d-4f93-9497-1b2281456463 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:38.959010 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79db0898-d30d-4f93-9497-1b2281456463 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:38.959698 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79db0898-d30d-4f93-9497-1b2281456463 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:38.960142 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79db0898-d30d-4f93-9497-1b2281456463 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:38.960555 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79db0898-d30d-4f93-9497-1b2281456463 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:39.106134 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-79db0898-d30d-4f93-9497-1b2281456463 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:39.114913 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-79db0898-d30d-4f93-9497-1b2281456463 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:39.117013 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-79db0898-d30d-4f93-9497-1b2281456463 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:39.118172 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-79db0898-d30d-4f93-9497-1b2281456463 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 0.172053 Sep 01 16:40:39.118753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 448/863] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:38 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:40.140958 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b82679e1-40fc-42d6-8c82-aa19fb428f26 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:40.141679 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b82679e1-40fc-42d6-8c82-aa19fb428f26 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:40.148274 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82679e1-40fc-42d6-8c82-aa19fb428f26 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:40.148756 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82679e1-40fc-42d6-8c82-aa19fb428f26 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:40.149187 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82679e1-40fc-42d6-8c82-aa19fb428f26 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:40.149873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82679e1-40fc-42d6-8c82-aa19fb428f26 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:40.150384 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82679e1-40fc-42d6-8c82-aa19fb428f26 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:40.150782 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b82679e1-40fc-42d6-8c82-aa19fb428f26 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:40.288506 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b82679e1-40fc-42d6-8c82-aa19fb428f26 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:40.297434 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b82679e1-40fc-42d6-8c82-aa19fb428f26 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:40.298901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b82679e1-40fc-42d6-8c82-aa19fb428f26 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:40.300321 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b82679e1-40fc-42d6-8c82-aa19fb428f26 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 0.163380 Sep 01 16:40:40.300882 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 416/864] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:40 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:41.329745 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-03db4ea5-206b-4f18-bf34-889bbdce273a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:41.330441 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-03db4ea5-206b-4f18-bf34-889bbdce273a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:41.336979 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03db4ea5-206b-4f18-bf34-889bbdce273a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:41.337734 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03db4ea5-206b-4f18-bf34-889bbdce273a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:41.338355 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03db4ea5-206b-4f18-bf34-889bbdce273a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:41.339876 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03db4ea5-206b-4f18-bf34-889bbdce273a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:41.340333 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03db4ea5-206b-4f18-bf34-889bbdce273a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:41.340747 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03db4ea5-206b-4f18-bf34-889bbdce273a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:41.528316 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-03db4ea5-206b-4f18-bf34-889bbdce273a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:41.543962 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-03db4ea5-206b-4f18-bf34-889bbdce273a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:41.545751 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-03db4ea5-206b-4f18-bf34-889bbdce273a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:41.551601 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-03db4ea5-206b-4f18-bf34-889bbdce273a tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 0.229244 Sep 01 16:40:41.552694 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 449/865] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:41 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:42.145694 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-85d8176a-763f-49ac-8d17-82c580d0d709 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:42.149859 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-85d8176a-763f-49ac-8d17-82c580d0d709 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:42.159405 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-85d8176a-763f-49ac-8d17-82c580d0d709 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.160047 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-85d8176a-763f-49ac-8d17-82c580d0d709 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.160598 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-85d8176a-763f-49ac-8d17-82c580d0d709 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.161402 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-85d8176a-763f-49ac-8d17-82c580d0d709 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.161950 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-85d8176a-763f-49ac-8d17-82c580d0d709 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.162512 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-85d8176a-763f-49ac-8d17-82c580d0d709 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.195986 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-85d8176a-763f-49ac-8d17-82c580d0d709 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054307 Sep 01 16:40:42.196577 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 417/866] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:40:42 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:42.339528 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a9bc54eb-a870-4d02-b61f-f7d3c6564666 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:42.341009 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a9bc54eb-a870-4d02-b61f-f7d3c6564666 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:42.349139 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9bc54eb-a870-4d02-b61f-f7d3c6564666 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.349875 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9bc54eb-a870-4d02-b61f-f7d3c6564666 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.350756 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9bc54eb-a870-4d02-b61f-f7d3c6564666 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.351646 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9bc54eb-a870-4d02-b61f-f7d3c6564666 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.352262 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9bc54eb-a870-4d02-b61f-f7d3c6564666 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.352999 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9bc54eb-a870-4d02-b61f-f7d3c6564666 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.386972 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a9bc54eb-a870-4d02-b61f-f7d3c6564666 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments/3c92dae5-fbc5-4adf-9513-50625a231267" status: 200 len: 194 microversion: 2.1 time: 0.051049 Sep 01 16:40:42.388170 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 450/867] 10.222.0.18 () {58 vars in 1413 bytes} [Thu Sep 1 16:40:42 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments/3c92dae5-fbc5-4adf-9513-50625a231267 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:42.399390 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-981b249b-34d4-47db-aadb-3ab3cdb564c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:42.399873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-981b249b-34d4-47db-aadb-3ab3cdb564c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:42.406425 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-981b249b-34d4-47db-aadb-3ab3cdb564c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.406915 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-981b249b-34d4-47db-aadb-3ab3cdb564c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.407349 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-981b249b-34d4-47db-aadb-3ab3cdb564c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.408037 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-981b249b-34d4-47db-aadb-3ab3cdb564c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.408482 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-981b249b-34d4-47db-aadb-3ab3cdb564c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.408900 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-981b249b-34d4-47db-aadb-3ab3cdb564c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.512966 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.objects.instance [None req-981b249b-34d4-47db-aadb-3ab3cdb564c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lazy-loading 'services' on Instance uuid 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f {{(pid=127178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:42.580071 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f380888e-32d2-4d76-ab58-a8357a80bde8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:42.580967 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f380888e-32d2-4d76-ab58-a8357a80bde8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:42.590518 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f380888e-32d2-4d76-ab58-a8357a80bde8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.591288 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f380888e-32d2-4d76-ab58-a8357a80bde8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.591939 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f380888e-32d2-4d76-ab58-a8357a80bde8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.592849 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f380888e-32d2-4d76-ab58-a8357a80bde8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.593631 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f380888e-32d2-4d76-ab58-a8357a80bde8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.594541 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f380888e-32d2-4d76-ab58-a8357a80bde8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.596206 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-981b249b-34d4-47db-aadb-3ab3cdb564c6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments/3c92dae5-fbc5-4adf-9513-50625a231267" status: 202 len: 0 microversion: 2.1 time: 0.200601 Sep 01 16:40:42.597999 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 418/868] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 1 16:40:42 2022] DELETE /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments/3c92dae5-fbc5-4adf-9513-50625a231267 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:40:42.800553 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f380888e-32d2-4d76-ab58-a8357a80bde8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:42.825120 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f380888e-32d2-4d76-ab58-a8357a80bde8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:42.827982 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f380888e-32d2-4d76-ab58-a8357a80bde8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:42.831694 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f380888e-32d2-4d76-ab58-a8357a80bde8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 0.259465 Sep 01 16:40:42.847173 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 451/869] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:42 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:43.863480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-beb16112-492b-44dc-a075-5b14230b7e7e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:43.865410 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-beb16112-492b-44dc-a075-5b14230b7e7e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:43.886629 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-beb16112-492b-44dc-a075-5b14230b7e7e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:43.887342 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-beb16112-492b-44dc-a075-5b14230b7e7e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:43.889036 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-beb16112-492b-44dc-a075-5b14230b7e7e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:43.889761 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-beb16112-492b-44dc-a075-5b14230b7e7e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:43.890228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-beb16112-492b-44dc-a075-5b14230b7e7e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:43.890658 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-beb16112-492b-44dc-a075-5b14230b7e7e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:44.125255 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-beb16112-492b-44dc-a075-5b14230b7e7e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:44.142079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-beb16112-492b-44dc-a075-5b14230b7e7e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:44.144116 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-beb16112-492b-44dc-a075-5b14230b7e7e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:44.146430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-beb16112-492b-44dc-a075-5b14230b7e7e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 0.291633 Sep 01 16:40:44.147448 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 419/870] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:43 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:44.816960 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4b78dbe5-b696-40da-a3e0-f5dfc0c0567f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:44.817438 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4b78dbe5-b696-40da-a3e0-f5dfc0c0567f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:44.824368 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4b78dbe5-b696-40da-a3e0-f5dfc0c0567f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:44.824803 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4b78dbe5-b696-40da-a3e0-f5dfc0c0567f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:44.825217 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4b78dbe5-b696-40da-a3e0-f5dfc0c0567f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:44.826082 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4b78dbe5-b696-40da-a3e0-f5dfc0c0567f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:44.826707 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4b78dbe5-b696-40da-a3e0-f5dfc0c0567f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:44.827308 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4b78dbe5-b696-40da-a3e0-f5dfc0c0567f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:44.830088 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:44.864495 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4b78dbe5-b696-40da-a3e0-f5dfc0c0567f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments/c7772096-914f-4f70-87f9-dab662bc544d" status: 200 len: 194 microversion: 2.1 time: 0.051290 Sep 01 16:40:44.864808 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 452/871] 10.222.0.18 () {58 vars in 1413 bytes} [Thu Sep 1 16:40:44 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments/c7772096-914f-4f70-87f9-dab662bc544d => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:44.876274 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-cd15eda3-04b5-4460-a017-0751ec9a2d62 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:44.877342 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-cd15eda3-04b5-4460-a017-0751ec9a2d62 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:44.880087 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=50 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:44.892397 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cd15eda3-04b5-4460-a017-0751ec9a2d62 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:44.893690 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cd15eda3-04b5-4460-a017-0751ec9a2d62 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:44.894996 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cd15eda3-04b5-4460-a017-0751ec9a2d62 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:44.896082 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cd15eda3-04b5-4460-a017-0751ec9a2d62 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:44.896706 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cd15eda3-04b5-4460-a017-0751ec9a2d62 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:44.916923 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cd15eda3-04b5-4460-a017-0751ec9a2d62 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:45.051087 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.objects.instance [None req-cd15eda3-04b5-4460-a017-0751ec9a2d62 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lazy-loading 'services' on Instance uuid 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f {{(pid=127178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:45.170605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-45927381-cbc4-4d12-b809-4958952aad89 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:45.171319 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-45927381-cbc4-4d12-b809-4958952aad89 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:45.178327 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45927381-cbc4-4d12-b809-4958952aad89 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:45.179123 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45927381-cbc4-4d12-b809-4958952aad89 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:45.179397 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-cd15eda3-04b5-4460-a017-0751ec9a2d62 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments/c7772096-914f-4f70-87f9-dab662bc544d" status: 202 len: 0 microversion: 2.1 time: 0.306319 Sep 01 16:40:45.180213 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45927381-cbc4-4d12-b809-4958952aad89 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:45.180999 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45927381-cbc4-4d12-b809-4958952aad89 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:45.181182 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 420/872] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 1 16:40:44 2022] DELETE /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments/c7772096-914f-4f70-87f9-dab662bc544d => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:40:45.181811 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45927381-cbc4-4d12-b809-4958952aad89 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:45.182341 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45927381-cbc4-4d12-b809-4958952aad89 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:45.337534 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-e5adf947-c893-4cbe-a8b7-08b34121050a req-5223d1d1-b1b7-48f7-816f-c71af55847cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d764e51-5b8a-4d17-886e-b52189448293", "name": "network-vif-plugged", "status": "completed", "tag": "5bb9e1c4-5809-406a-8024-a9bfe99bb842"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:45.356656 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-e5adf947-c893-4cbe-a8b7-08b34121050a req-5223d1d1-b1b7-48f7-816f-c71af55847cf service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:45.359018 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-e5adf947-c893-4cbe-a8b7-08b34121050a req-5223d1d1-b1b7-48f7-816f-c71af55847cf service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:45.360635 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-e5adf947-c893-4cbe-a8b7-08b34121050a req-5223d1d1-b1b7-48f7-816f-c71af55847cf service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:45.389096 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-e5adf947-c893-4cbe-a8b7-08b34121050a req-5223d1d1-b1b7-48f7-816f-c71af55847cf service nova] Creating event network-vif-plugged:5bb9e1c4-5809-406a-8024-a9bfe99bb842 for instance 7d764e51-5b8a-4d17-886e-b52189448293 on hv-cinder-85220 Sep 01 16:40:45.401739 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-e5adf947-c893-4cbe-a8b7-08b34121050a req-5223d1d1-b1b7-48f7-816f-c71af55847cf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066313 Sep 01 16:40:45.402682 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 421/873] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:45.443057 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-45927381-cbc4-4d12-b809-4958952aad89 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:45.453689 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-45927381-cbc4-4d12-b809-4958952aad89 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:45.455528 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-45927381-cbc4-4d12-b809-4958952aad89 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:45.456938 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-45927381-cbc4-4d12-b809-4958952aad89 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 0.290838 Sep 01 16:40:45.457856 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 453/874] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:45 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:46.483289 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c22e28f9-7cb4-453d-98ff-9cc1284eb8a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:46.485324 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c22e28f9-7cb4-453d-98ff-9cc1284eb8a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:46.501788 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c22e28f9-7cb4-453d-98ff-9cc1284eb8a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:46.502623 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c22e28f9-7cb4-453d-98ff-9cc1284eb8a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:46.504087 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c22e28f9-7cb4-453d-98ff-9cc1284eb8a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:46.504228 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ffd0bbd9-834c-4b3f-8817-c4e8c7764070 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:46.504701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c22e28f9-7cb4-453d-98ff-9cc1284eb8a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:46.505605 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c22e28f9-7cb4-453d-98ff-9cc1284eb8a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:46.506188 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c22e28f9-7cb4-453d-98ff-9cc1284eb8a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:46.506369 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ffd0bbd9-834c-4b3f-8817-c4e8c7764070 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:46.515241 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ffd0bbd9-834c-4b3f-8817-c4e8c7764070 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:46.516138 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ffd0bbd9-834c-4b3f-8817-c4e8c7764070 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:46.516768 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ffd0bbd9-834c-4b3f-8817-c4e8c7764070 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:46.517709 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ffd0bbd9-834c-4b3f-8817-c4e8c7764070 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:46.518846 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ffd0bbd9-834c-4b3f-8817-c4e8c7764070 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:46.519519 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ffd0bbd9-834c-4b3f-8817-c4e8c7764070 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:46.555226 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ffd0bbd9-834c-4b3f-8817-c4e8c7764070 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055091 Sep 01 16:40:46.556347 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 454/875] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:40:46 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:46.761871 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c22e28f9-7cb4-453d-98ff-9cc1284eb8a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:46.771091 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c22e28f9-7cb4-453d-98ff-9cc1284eb8a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:46.772895 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c22e28f9-7cb4-453d-98ff-9cc1284eb8a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:46.774104 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c22e28f9-7cb4-453d-98ff-9cc1284eb8a8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 0.297169 Sep 01 16:40:46.774697 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 422/876] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:46 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:47.570056 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3b0823aa-22b9-421d-a418-131bbfaae995 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:47.572750 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3b0823aa-22b9-421d-a418-131bbfaae995 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:47.587071 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3b0823aa-22b9-421d-a418-131bbfaae995 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:47.587793 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3b0823aa-22b9-421d-a418-131bbfaae995 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:47.588624 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3b0823aa-22b9-421d-a418-131bbfaae995 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:47.589689 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3b0823aa-22b9-421d-a418-131bbfaae995 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:47.590415 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3b0823aa-22b9-421d-a418-131bbfaae995 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:47.591288 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3b0823aa-22b9-421d-a418-131bbfaae995 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:47.630803 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3b0823aa-22b9-421d-a418-131bbfaae995 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065636 Sep 01 16:40:47.631990 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 455/877] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:40:47 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:40:47.797320 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-407363a3-4311-4533-8533-de68087a28cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:47.797933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-407363a3-4311-4533-8533-de68087a28cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:47.805053 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-407363a3-4311-4533-8533-de68087a28cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:47.819124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-43904e26-af3d-4c74-86e2-ad6b96b47238 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:47.825032 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-407363a3-4311-4533-8533-de68087a28cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:47.825592 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-407363a3-4311-4533-8533-de68087a28cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:47.826311 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-43904e26-af3d-4c74-86e2-ad6b96b47238 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:47.826877 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-407363a3-4311-4533-8533-de68087a28cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:47.827341 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-407363a3-4311-4533-8533-de68087a28cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:47.827770 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-407363a3-4311-4533-8533-de68087a28cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:47.836600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:47.854119 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43904e26-af3d-4c74-86e2-ad6b96b47238 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:47.854491 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43904e26-af3d-4c74-86e2-ad6b96b47238 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:47.856927 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43904e26-af3d-4c74-86e2-ad6b96b47238 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:47.858909 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43904e26-af3d-4c74-86e2-ad6b96b47238 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:47.860001 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43904e26-af3d-4c74-86e2-ad6b96b47238 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:47.861026 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43904e26-af3d-4c74-86e2-ad6b96b47238 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:47.970720 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-43904e26-af3d-4c74-86e2-ad6b96b47238 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.162601 Sep 01 16:40:47.971596 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 456/878] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:40:47 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f/os-volume_attachments => generated 25 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:40:48.089202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c8ecbba2-d20a-4aca-9195-187f95ce40e3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:48.089523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c8ecbba2-d20a-4aca-9195-187f95ce40e3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:48.097921 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8ecbba2-d20a-4aca-9195-187f95ce40e3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:48.100300 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8ecbba2-d20a-4aca-9195-187f95ce40e3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:48.107087 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8ecbba2-d20a-4aca-9195-187f95ce40e3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:48.108234 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8ecbba2-d20a-4aca-9195-187f95ce40e3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:48.108926 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8ecbba2-d20a-4aca-9195-187f95ce40e3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:48.109534 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8ecbba2-d20a-4aca-9195-187f95ce40e3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:48.163894 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c8ecbba2-d20a-4aca-9195-187f95ce40e3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:40:48.346561 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c8ecbba2-d20a-4aca-9195-187f95ce40e3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 204 len: 0 microversion: 2.1 time: 0.260921 Sep 01 16:40:48.348200 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 457/879] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:40:48 2022] DELETE /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 16:40:48.358015 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-49c30093-b390-4707-bd1b-9d2ea9a71b0a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:48.359192 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-49c30093-b390-4707-bd1b-9d2ea9a71b0a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:48.372810 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49c30093-b390-4707-bd1b-9d2ea9a71b0a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:48.373304 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49c30093-b390-4707-bd1b-9d2ea9a71b0a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:48.373739 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49c30093-b390-4707-bd1b-9d2ea9a71b0a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:48.374478 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49c30093-b390-4707-bd1b-9d2ea9a71b0a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:48.375012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49c30093-b390-4707-bd1b-9d2ea9a71b0a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:48.382989 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49c30093-b390-4707-bd1b-9d2ea9a71b0a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:48.672550 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-49c30093-b390-4707-bd1b-9d2ea9a71b0a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:48.683849 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-49c30093-b390-4707-bd1b-9d2ea9a71b0a tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 200 len: 1672 microversion: 2.1 time: 0.329291 Sep 01 16:40:48.684467 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 458/880] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:48 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 1672 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:48.810942 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-407363a3-4311-4533-8533-de68087a28cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:48.824831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-407363a3-4311-4533-8533-de68087a28cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:48.826753 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-407363a3-4311-4533-8533-de68087a28cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:48.828565 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-407363a3-4311-4533-8533-de68087a28cf tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 1.035106 Sep 01 16:40:48.829295 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 423/881] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:47 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:49.705069 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a20aade5-1d68-4720-a78f-13c239ece170 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:49.705658 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a20aade5-1d68-4720-a78f-13c239ece170 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:49.723962 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a20aade5-1d68-4720-a78f-13c239ece170 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:49.726353 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a20aade5-1d68-4720-a78f-13c239ece170 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:49.727044 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a20aade5-1d68-4720-a78f-13c239ece170 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:49.728038 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a20aade5-1d68-4720-a78f-13c239ece170 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:49.729702 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a20aade5-1d68-4720-a78f-13c239ece170 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:49.730434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a20aade5-1d68-4720-a78f-13c239ece170 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:49.857288 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-dee79207-10c9-4248-b93d-9d11a84a8435 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:49.859278 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-dee79207-10c9-4248-b93d-9d11a84a8435 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:49.866684 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dee79207-10c9-4248-b93d-9d11a84a8435 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:49.867490 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dee79207-10c9-4248-b93d-9d11a84a8435 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:49.868129 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dee79207-10c9-4248-b93d-9d11a84a8435 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:49.869036 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dee79207-10c9-4248-b93d-9d11a84a8435 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:49.869770 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dee79207-10c9-4248-b93d-9d11a84a8435 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:49.870509 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-dee79207-10c9-4248-b93d-9d11a84a8435 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:50.027190 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-dee79207-10c9-4248-b93d-9d11a84a8435 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:50.039403 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-dee79207-10c9-4248-b93d-9d11a84a8435 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:50.043246 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-dee79207-10c9-4248-b93d-9d11a84a8435 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:50.044766 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-dee79207-10c9-4248-b93d-9d11a84a8435 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1731 microversion: 2.20 time: 0.191880 Sep 01 16:40:50.047831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 424/882] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:49 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:50.059059 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a20aade5-1d68-4720-a78f-13c239ece170 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:50.068873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a20aade5-1d68-4720-a78f-13c239ece170 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 200 len: 1672 microversion: 2.1 time: 0.367566 Sep 01 16:40:50.069469 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 459/883] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:49 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 1672 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:51.070874 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d3e5e6f9-e5c9-453a-9823-fb0d05a1e4ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:51.072214 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d3e5e6f9-e5c9-453a-9823-fb0d05a1e4ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:51.081606 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3e5e6f9-e5c9-453a-9823-fb0d05a1e4ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:51.088074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3e5e6f9-e5c9-453a-9823-fb0d05a1e4ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:51.091124 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3e5e6f9-e5c9-453a-9823-fb0d05a1e4ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:51.092222 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3e5e6f9-e5c9-453a-9823-fb0d05a1e4ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:51.092917 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3e5e6f9-e5c9-453a-9823-fb0d05a1e4ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:51.094772 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d3e5e6f9-e5c9-453a-9823-fb0d05a1e4ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:51.097440 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-767b8e8f-0b79-46cf-9fa2-c51eceffc7a6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:51.098055 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-767b8e8f-0b79-46cf-9fa2-c51eceffc7a6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:51.112102 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-767b8e8f-0b79-46cf-9fa2-c51eceffc7a6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:51.112862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-767b8e8f-0b79-46cf-9fa2-c51eceffc7a6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:51.113676 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-767b8e8f-0b79-46cf-9fa2-c51eceffc7a6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:51.114608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-767b8e8f-0b79-46cf-9fa2-c51eceffc7a6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:51.118969 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-767b8e8f-0b79-46cf-9fa2-c51eceffc7a6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:51.121146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-767b8e8f-0b79-46cf-9fa2-c51eceffc7a6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:51.292516 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-767b8e8f-0b79-46cf-9fa2-c51eceffc7a6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:51.313780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-767b8e8f-0b79-46cf-9fa2-c51eceffc7a6 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 200 len: 1605 microversion: 2.1 time: 0.222340 Sep 01 16:40:51.314992 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 460/884] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:51 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 1605 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:51.440193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d3e5e6f9-e5c9-453a-9823-fb0d05a1e4ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:51.453407 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d3e5e6f9-e5c9-453a-9823-fb0d05a1e4ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:51.456670 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d3e5e6f9-e5c9-453a-9823-fb0d05a1e4ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:51.461080 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d3e5e6f9-e5c9-453a-9823-fb0d05a1e4ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1718 microversion: 2.20 time: 0.393892 Sep 01 16:40:51.462400 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 425/885] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:51 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1718 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:51.727433 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-d01c36ce-ae4f-4cbb-a82d-2e149d1aa4e1 req-f8576c22-15bb-48e8-87b6-09239431fbad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e32ddc7-b8fb-420e-8a40-f3cde9dc120f", "name": "network-vif-deleted", "tag": "3e0bb2c3-4cfe-4397-8e97-194bac0a5051"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:51.740712 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-d01c36ce-ae4f-4cbb-a82d-2e149d1aa4e1 req-f8576c22-15bb-48e8-87b6-09239431fbad service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:51.741603 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-d01c36ce-ae4f-4cbb-a82d-2e149d1aa4e1 req-f8576c22-15bb-48e8-87b6-09239431fbad service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:51.742217 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-d01c36ce-ae4f-4cbb-a82d-2e149d1aa4e1 req-f8576c22-15bb-48e8-87b6-09239431fbad service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:51.764535 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-d01c36ce-ae4f-4cbb-a82d-2e149d1aa4e1 req-f8576c22-15bb-48e8-87b6-09239431fbad service nova] Creating event network-vif-deleted:3e0bb2c3-4cfe-4397-8e97-194bac0a5051 for instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f on hv-cinder-85220 Sep 01 16:40:51.772701 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-d01c36ce-ae4f-4cbb-a82d-2e149d1aa4e1 req-f8576c22-15bb-48e8-87b6-09239431fbad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048916 Sep 01 16:40:51.784891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 461/886] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:52.339258 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-4d22f9fe-c561-4ef8-a03d-21b3ebef08a3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:52.340459 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-4d22f9fe-c561-4ef8-a03d-21b3ebef08a3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:52.363141 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4d22f9fe-c561-4ef8-a03d-21b3ebef08a3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:52.363849 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4d22f9fe-c561-4ef8-a03d-21b3ebef08a3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:52.364415 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4d22f9fe-c561-4ef8-a03d-21b3ebef08a3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:52.365245 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4d22f9fe-c561-4ef8-a03d-21b3ebef08a3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:52.369257 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4d22f9fe-c561-4ef8-a03d-21b3ebef08a3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:52.370454 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4d22f9fe-c561-4ef8-a03d-21b3ebef08a3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:52.423130 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4d22f9fe-c561-4ef8-a03d-21b3ebef08a3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:52.423693 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4d22f9fe-c561-4ef8-a03d-21b3ebef08a3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:52.424396 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4d22f9fe-c561-4ef8-a03d-21b3ebef08a3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:52.425054 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.objects.instance [None req-4d22f9fe-c561-4ef8-a03d-21b3ebef08a3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lazy-loading 'fault' on Instance uuid 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f {{(pid=127178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:52.480663 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-4d22f9fe-c561-4ef8-a03d-21b3ebef08a3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73624e79ccdd4782beddf663bb6d02e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab96a55de014d8cac2c004ba7cadedd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:52.484838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:52.491031 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-4d22f9fe-c561-4ef8-a03d-21b3ebef08a3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 200 len: 1326 microversion: 2.1 time: 0.155790 Sep 01 16:40:52.492333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 426/887] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:52 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 1326 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:53.519254 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-10a4a1a3-df78-4282-9820-ccd5b62555cb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:53.520525 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-10a4a1a3-df78-4282-9820-ccd5b62555cb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:53.534301 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10a4a1a3-df78-4282-9820-ccd5b62555cb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:53.535093 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10a4a1a3-df78-4282-9820-ccd5b62555cb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:53.535741 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10a4a1a3-df78-4282-9820-ccd5b62555cb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:53.536632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10a4a1a3-df78-4282-9820-ccd5b62555cb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:53.537280 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10a4a1a3-df78-4282-9820-ccd5b62555cb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:53.538159 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10a4a1a3-df78-4282-9820-ccd5b62555cb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:53.561675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-10a4a1a3-df78-4282-9820-ccd5b62555cb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] HTTP exception thrown: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-10a4a1a3-df78-4282-9820-ccd5b62555cb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Request method failure captured: Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f HTTP/1.1 Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN8BAisc9tDZeX_1hRyjrfel6EzySTSdpIsiTzrOheWVN5nYSXDgHpk9Ift87hcqqBbIaN6Y5bvK9fVjZh8YIKPfaX66BP85jlsDOEOhoI-xgRPS8ArBAANwoZHGadv0p2sb8zEfYom6h9gQkqSaiLRWZAWrgGhoNrgq8gH-E9dM_co Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: aab96a55de014d8cac2c004ba7cadedd Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:40:53.564028 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:40:53.565386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:40:53.565386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:40:53.565386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: aab96a55de014d8cac2c004ba7cadedd Sep 01 16:40:53.565386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:40:53.565386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeTestJSON-1785464243-project Sep 01 16:40:53.565386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:40:53.565386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:40:53.565386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: 73624e79ccdd4782beddf663bb6d02e1 Sep 01 16:40:53.565386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeTestJSON-1785464243-project Sep 01 16:40:53.565386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:40:53.565386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. Sep 01 16:40:53.565386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': '7e32ddc7-b8fb-420e-8a40-f3cde9dc120f'} Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:40:53.566391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. Sep 01 16:40:53.567738 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:40:53.568848 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-10a4a1a3-df78-4282-9820-ccd5b62555cb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Returning 404 to user: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:40:53.568848 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-10a4a1a3-df78-4282-9820-ccd5b62555cb tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 404 len: 111 microversion: 2.1 time: 0.054611 Sep 01 16:40:53.574228 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 462/888] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:53 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:40:53.580227 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-26f87697-d843-4e66-9906-01ae49833c24 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '.version_select at 0x7feeec0a4ee0>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:53.605988 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-26f87697-d843-4e66-9906-01ae49833c24 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502619831" status: 202 len: 0 microversion: 2.1 time: 0.031771 Sep 01 16:40:53.606914 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 427/889] 10.222.0.18 () {58 vars in 1221 bytes} [Thu Sep 1 16:40:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502619831 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:40:56.850354 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-838fbe4c-6097-4216-b13f-be7cb1682d4f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:56.851125 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-838fbe4c-6097-4216-b13f-be7cb1682d4f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:56.860345 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-838fbe4c-6097-4216-b13f-be7cb1682d4f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:56.861208 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-838fbe4c-6097-4216-b13f-be7cb1682d4f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:56.861879 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-838fbe4c-6097-4216-b13f-be7cb1682d4f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:56.864382 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-838fbe4c-6097-4216-b13f-be7cb1682d4f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:56.865094 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-838fbe4c-6097-4216-b13f-be7cb1682d4f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:56.865754 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-838fbe4c-6097-4216-b13f-be7cb1682d4f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:56.888047 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-838fbe4c-6097-4216-b13f-be7cb1682d4f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] HTTP exception thrown: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-838fbe4c-6097-4216-b13f-be7cb1682d4f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Request method failure captured: Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: DELETE /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f HTTP/1.1 Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN8BAisc9tDZeX_1hRyjrfel6EzySTSdpIsiTzrOheWVN5nYSXDgHpk9Ift87hcqqBbIaN6Y5bvK9fVjZh8YIKPfaX66BP85jlsDOEOhoI-xgRPS8ArBAANwoZHGadv0p2sb8zEfYom6h9gQkqSaiLRWZAWrgGhoNrgq8gH-E9dM_co Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: aab96a55de014d8cac2c004ba7cadedd Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:40:56.889805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:40:56.891532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:40:56.891532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:40:56.891532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: aab96a55de014d8cac2c004ba7cadedd Sep 01 16:40:56.891532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:40:56.891532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeTestJSON-1785464243-project Sep 01 16:40:56.891532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:40:56.891532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:40:56.891532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: 73624e79ccdd4782beddf663bb6d02e1 Sep 01 16:40:56.891532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeTestJSON-1785464243-project Sep 01 16:40:56.891532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:40:56.891532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. Sep 01 16:40:56.891532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': '7e32ddc7-b8fb-420e-8a40-f3cde9dc120f'} Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:40:56.892412 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. Sep 01 16:40:56.895652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:40:56.896814 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-838fbe4c-6097-4216-b13f-be7cb1682d4f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Returning 404 to user: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:40:56.896814 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-838fbe4c-6097-4216-b13f-be7cb1682d4f tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 404 len: 111 microversion: 2.1 time: 0.048884 Sep 01 16:40:56.896814 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 463/890] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:40:56 2022] DELETE /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:40:56.905516 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-397b1b6c-1d19-4bdf-8b77-90c698a4dbc3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:56.906223 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-397b1b6c-1d19-4bdf-8b77-90c698a4dbc3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:56.922868 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-397b1b6c-1d19-4bdf-8b77-90c698a4dbc3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:56.923457 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-397b1b6c-1d19-4bdf-8b77-90c698a4dbc3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:56.923961 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-397b1b6c-1d19-4bdf-8b77-90c698a4dbc3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:56.924734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-397b1b6c-1d19-4bdf-8b77-90c698a4dbc3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:56.925259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-397b1b6c-1d19-4bdf-8b77-90c698a4dbc3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:56.925673 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-397b1b6c-1d19-4bdf-8b77-90c698a4dbc3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:56.941158 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-397b1b6c-1d19-4bdf-8b77-90c698a4dbc3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] HTTP exception thrown: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-397b1b6c-1d19-4bdf-8b77-90c698a4dbc3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Request method failure captured: Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f HTTP/1.1 Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN8BAisc9tDZeX_1hRyjrfel6EzySTSdpIsiTzrOheWVN5nYSXDgHpk9Ift87hcqqBbIaN6Y5bvK9fVjZh8YIKPfaX66BP85jlsDOEOhoI-xgRPS8ArBAANwoZHGadv0p2sb8zEfYom6h9gQkqSaiLRWZAWrgGhoNrgq8gH-E9dM_co Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: aab96a55de014d8cac2c004ba7cadedd Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:40:56.943167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:40:56.944430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:40:56.944430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:40:56.944430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: aab96a55de014d8cac2c004ba7cadedd Sep 01 16:40:56.944430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:40:56.944430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-AttachVolumeTestJSON-1785464243-project Sep 01 16:40:56.944430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:40:56.944430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:40:56.944430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: 73624e79ccdd4782beddf663bb6d02e1 Sep 01 16:40:56.944430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-AttachVolumeTestJSON-1785464243-project Sep 01 16:40:56.944430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:40:56.944430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. Sep 01 16:40:56.944430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': '7e32ddc7-b8fb-420e-8a40-f3cde9dc120f'} Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:40:56.945136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. Sep 01 16:40:56.946326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:40:56.949466 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-397b1b6c-1d19-4bdf-8b77-90c698a4dbc3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Returning 404 to user: Instance 7e32ddc7-b8fb-420e-8a40-f3cde9dc120f could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:40:56.949466 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-397b1b6c-1d19-4bdf-8b77-90c698a4dbc3 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f" status: 404 len: 111 microversion: 2.1 time: 0.047717 Sep 01 16:40:56.949466 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 428/891] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:56 2022] GET /compute/v2.1/servers/7e32ddc7-b8fb-420e-8a40-f3cde9dc120f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:40:58.166764 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4d451763-d859-45d4-843d-25f0d2f5ba81 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:58.167265 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4d451763-d859-45d4-843d-25f0d2f5ba81 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:58.173890 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d451763-d859-45d4-843d-25f0d2f5ba81 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:58.174600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d451763-d859-45d4-843d-25f0d2f5ba81 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:58.175196 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d451763-d859-45d4-843d-25f0d2f5ba81 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:58.176039 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d451763-d859-45d4-843d-25f0d2f5ba81 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:58.176665 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d451763-d859-45d4-843d-25f0d2f5ba81 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:58.177231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d451763-d859-45d4-843d-25f0d2f5ba81 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:58.192389 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-4d451763-d859-45d4-843d-25f0d2f5ba81 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] HTTP exception thrown: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4d451763-d859-45d4-843d-25f0d2f5ba81 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Request method failure captured: Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: DELETE /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f HTTP/1.1 Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN8BAisc9tDZeX_1hRyjrfel6EzySTSdpIsiTzrOheWVN5nYSXDgHpk9Ift87hcqqBbIaN6Y5bvK9fVjZh8YIKPfaX66BP85jlsDOEOhoI-xgRPS8ArBAANwoZHGadv0p2sb8zEfYom6h9gQkqSaiLRWZAWrgGhoNrgq8gH-E9dM_co Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: aab96a55de014d8cac2c004ba7cadedd Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:40:58.194112 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:40:58.195527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:40:58.195527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:40:58.195527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: aab96a55de014d8cac2c004ba7cadedd Sep 01 16:40:58.195527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:40:58.195527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeTestJSON-1785464243-project Sep 01 16:40:58.195527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:40:58.195527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:40:58.195527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: 73624e79ccdd4782beddf663bb6d02e1 Sep 01 16:40:58.195527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeTestJSON-1785464243-project Sep 01 16:40:58.195527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:40:58.195527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. Sep 01 16:40:58.195527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': 'f220c0ef-c9c6-4fb0-995b-6daea95e841f'} Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:40:58.196361 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. Sep 01 16:40:58.198632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:40:58.200861 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4d451763-d859-45d4-843d-25f0d2f5ba81 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Returning 404 to user: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:40:58.200861 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4d451763-d859-45d4-843d-25f0d2f5ba81 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 404 len: 111 microversion: 2.1 time: 0.032710 Sep 01 16:40:58.200861 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 464/892] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:40:58 2022] DELETE /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:40:58.204808 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-74b2b2ee-3fcd-4b41-b6d1-60f373a68239 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:58.205422 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-74b2b2ee-3fcd-4b41-b6d1-60f373a68239 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] [instance: f220c0ef-c9c6-4fb0-995b-6daea95e841f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:58.212696 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-74b2b2ee-3fcd-4b41-b6d1-60f373a68239 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:58.213173 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-74b2b2ee-3fcd-4b41-b6d1-60f373a68239 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:58.213651 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-74b2b2ee-3fcd-4b41-b6d1-60f373a68239 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:58.214357 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-74b2b2ee-3fcd-4b41-b6d1-60f373a68239 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:58.214805 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-74b2b2ee-3fcd-4b41-b6d1-60f373a68239 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:58.215218 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-74b2b2ee-3fcd-4b41-b6d1-60f373a68239 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:58.231391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-74b2b2ee-3fcd-4b41-b6d1-60f373a68239 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] HTTP exception thrown: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-74b2b2ee-3fcd-4b41-b6d1-60f373a68239 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Request method failure captured: Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f HTTP/1.1 Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN8BAisc9tDZeX_1hRyjrfel6EzySTSdpIsiTzrOheWVN5nYSXDgHpk9Ift87hcqqBbIaN6Y5bvK9fVjZh8YIKPfaX66BP85jlsDOEOhoI-xgRPS8ArBAANwoZHGadv0p2sb8zEfYom6h9gQkqSaiLRWZAWrgGhoNrgq8gH-E9dM_co Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: aab96a55de014d8cac2c004ba7cadedd Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:40:58.232925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:40:58.234193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aab96a55de014d8cac2c004ba7cadedd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:40:58.234193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:40:58.234193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: aab96a55de014d8cac2c004ba7cadedd Sep 01 16:40:58.234193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1785464243 Sep 01 16:40:58.234193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-AttachVolumeTestJSON-1785464243-project Sep 01 16:40:58.234193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:40:58.234193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:40:58.234193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: 73624e79ccdd4782beddf663bb6d02e1 Sep 01 16:40:58.234193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-AttachVolumeTestJSON-1785464243-project Sep 01 16:40:58.234193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:40:58.234193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. Sep 01 16:40:58.234193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': 'f220c0ef-c9c6-4fb0-995b-6daea95e841f'} Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:40:58.235074 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. Sep 01 16:40:58.236212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:40:58.237216 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-74b2b2ee-3fcd-4b41-b6d1-60f373a68239 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] Returning 404 to user: Instance f220c0ef-c9c6-4fb0-995b-6daea95e841f could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:40:58.237216 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-74b2b2ee-3fcd-4b41-b6d1-60f373a68239 tempest-AttachVolumeTestJSON-1785464243 tempest-AttachVolumeTestJSON-1785464243-project] 10.222.0.18 "GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f" status: 404 len: 111 microversion: 2.1 time: 0.033362 Sep 01 16:40:58.238439 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 429/893] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:58 2022] GET /compute/v2.1/servers/f220c0ef-c9c6-4fb0-995b-6daea95e841f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:00.621083 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f343e727-7eec-4ce6-b9bb-b6b412d9fa2f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Action: 'create', calling method: .version_select at 0x7feee7fce280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1922573567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzMRY5aQmOgFuxn9EexZlXb8OwthQMKYTBumBvmCNsu/M/+R6Eh59c4FJZXcXUMU+bplw7MMj71rhcxd3BvKRHtYfT39G3pyjVeY+QAQ2gJmoHKimvzIBvxfJY02RsNFg=="}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:00.638009 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-f343e727-7eec-4ce6-b9bb-b6b412d9fa2f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Getting quotas for project 13ab20a85384485e95e2c0dadcc8b43c. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:41:00.642434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-f343e727-7eec-4ce6-b9bb-b6b412d9fa2f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Getting quotas for user 003d7b8eee13419780bb5e055a01bb77 and project 13ab20a85384485e95e2c0dadcc8b43c. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:41:00.669458 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f343e727-7eec-4ce6-b9bb-b6b412d9fa2f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052878 Sep 01 16:41:00.674793 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 465/894] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 1 16:41:00 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:00.724285 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-818337137", "imageRef": "542e5668-8dc8-41c0-812e-3bfac0021872", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1922573567", "networks": [{"uuid": "39b32e89-2562-41b6-8f54-e0086889d468"}]}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:00.780389 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.network.neutron [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] validate_networks() for [('39b32e89-2562-41b6-8f54-e0086889d468', None, None, None, None, None)] {{(pid=127178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:41:01.355554 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Flavor limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:41:01.355970 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Image limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:41:01.356432 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Flavor pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:41:01.356836 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Image pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:41:01.357238 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:41:01.368098 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:01.368571 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:01.369009 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:01.370299 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:01.370761 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:01.371442 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:01.389121 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Getting quotas for project 13ab20a85384485e95e2c0dadcc8b43c. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:41:01.393127 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Getting quotas for user 003d7b8eee13419780bb5e055a01bb77 and project 13ab20a85384485e95e2c0dadcc8b43c. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:41:01.404269 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Going to run 1 instances... {{(pid=127178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:41:01.406637 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='542e5668-8dc8-41c0-812e-3bfac0021872',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:41:01.457930 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7f2789a5-724e-46ae-9025-971a1b8dc6ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737351 Sep 01 16:41:01.464982 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 430/895] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:41:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:41:01.471487 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-89b26785-e5d0-4656-a5e6-4a33750ae9ce tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:01.473497 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-89b26785-e5d0-4656-a5e6-4a33750ae9ce tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:01.604964 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-89b26785-e5d0-4656-a5e6-4a33750ae9ce tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:01.613432 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-89b26785-e5d0-4656-a5e6-4a33750ae9ce tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1258 microversion: 2.1 time: 0.145967 Sep 01 16:41:01.614653 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 466/896] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:01 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1258 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:02.640734 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-2f9831fd-45ed-4e33-89c1-e03c370697ca tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:02.641346 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-2f9831fd-45ed-4e33-89c1-e03c370697ca tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:02.649461 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2f9831fd-45ed-4e33-89c1-e03c370697ca tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:02.650004 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2f9831fd-45ed-4e33-89c1-e03c370697ca tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:02.650351 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2f9831fd-45ed-4e33-89c1-e03c370697ca tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:02.651539 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2f9831fd-45ed-4e33-89c1-e03c370697ca tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:02.651990 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2f9831fd-45ed-4e33-89c1-e03c370697ca tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:02.652402 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2f9831fd-45ed-4e33-89c1-e03c370697ca tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:02.713994 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2f9831fd-45ed-4e33-89c1-e03c370697ca tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:02.721595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-2f9831fd-45ed-4e33-89c1-e03c370697ca tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1310 microversion: 2.1 time: 0.085449 Sep 01 16:41:02.722153 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 431/897] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:02 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:03.742594 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6af77024-9d48-4ef3-9121-d45526eb7636 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:03.743195 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6af77024-9d48-4ef3-9121-d45526eb7636 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:03.753189 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6af77024-9d48-4ef3-9121-d45526eb7636 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:03.753672 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6af77024-9d48-4ef3-9121-d45526eb7636 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:03.754124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6af77024-9d48-4ef3-9121-d45526eb7636 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:03.755047 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6af77024-9d48-4ef3-9121-d45526eb7636 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:03.756460 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6af77024-9d48-4ef3-9121-d45526eb7636 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:03.756962 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6af77024-9d48-4ef3-9121-d45526eb7636 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:04.078120 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6af77024-9d48-4ef3-9121-d45526eb7636 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:04.086533 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6af77024-9d48-4ef3-9121-d45526eb7636 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1358 microversion: 2.1 time: 0.347595 Sep 01 16:41:04.087669 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 467/898] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:03 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1358 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:04.842113 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-2cd490f8-d218-4872-ac77-77cd54fa44b1 req-01a74359-fca4-4e97-a74f-4355d364882f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840b3e8c-3b9a-44ee-8f03-43d332ca8b26", "tag": "229f7341-6966-4b67-9657-ed92a6db27a4"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:04.858487 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-2cd490f8-d218-4872-ac77-77cd54fa44b1 req-01a74359-fca4-4e97-a74f-4355d364882f service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:04.858894 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-2cd490f8-d218-4872-ac77-77cd54fa44b1 req-01a74359-fca4-4e97-a74f-4355d364882f service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:04.859319 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-2cd490f8-d218-4872-ac77-77cd54fa44b1 req-01a74359-fca4-4e97-a74f-4355d364882f service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:04.876611 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-2cd490f8-d218-4872-ac77-77cd54fa44b1 req-01a74359-fca4-4e97-a74f-4355d364882f service nova] Creating event network-changed:229f7341-6966-4b67-9657-ed92a6db27a4 for instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 on hv-cinder-85220 Sep 01 16:41:04.882532 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-2cd490f8-d218-4872-ac77-77cd54fa44b1 req-01a74359-fca4-4e97-a74f-4355d364882f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044482 Sep 01 16:41:04.883157 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 432/899] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:41:05.108390 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5dec6bf0-26bc-4216-8881-80c57171236a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:05.109033 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5dec6bf0-26bc-4216-8881-80c57171236a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:05.115556 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5dec6bf0-26bc-4216-8881-80c57171236a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:05.116030 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5dec6bf0-26bc-4216-8881-80c57171236a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:05.116455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5dec6bf0-26bc-4216-8881-80c57171236a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:05.117144 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5dec6bf0-26bc-4216-8881-80c57171236a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:05.117589 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5dec6bf0-26bc-4216-8881-80c57171236a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:05.118003 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5dec6bf0-26bc-4216-8881-80c57171236a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:05.255601 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5dec6bf0-26bc-4216-8881-80c57171236a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:05.263812 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5dec6bf0-26bc-4216-8881-80c57171236a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1358 microversion: 2.1 time: 0.159209 Sep 01 16:41:05.264540 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 468/900] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:05 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:06.285863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-0f055189-553c-46af-9360-081053d3d322 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:06.287093 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0f055189-553c-46af-9360-081053d3d322 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:06.308909 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0f055189-553c-46af-9360-081053d3d322 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:06.309391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0f055189-553c-46af-9360-081053d3d322 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:06.309832 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0f055189-553c-46af-9360-081053d3d322 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:06.312891 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0f055189-553c-46af-9360-081053d3d322 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:06.313328 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0f055189-553c-46af-9360-081053d3d322 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:06.314008 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0f055189-553c-46af-9360-081053d3d322 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:06.484819 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0f055189-553c-46af-9360-081053d3d322 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:06.492607 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-0f055189-553c-46af-9360-081053d3d322 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1358 microversion: 2.1 time: 0.211382 Sep 01 16:41:06.493174 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 433/901] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:06 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:07.513395 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-99d2eb84-671b-497c-a8c0-2940a506b064 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:07.514481 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-99d2eb84-671b-497c-a8c0-2940a506b064 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:07.521614 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99d2eb84-671b-497c-a8c0-2940a506b064 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:07.522102 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99d2eb84-671b-497c-a8c0-2940a506b064 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:07.522631 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99d2eb84-671b-497c-a8c0-2940a506b064 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:07.523524 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99d2eb84-671b-497c-a8c0-2940a506b064 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:07.524455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99d2eb84-671b-497c-a8c0-2940a506b064 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:07.524991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99d2eb84-671b-497c-a8c0-2940a506b064 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:07.674974 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-99d2eb84-671b-497c-a8c0-2940a506b064 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:07.684032 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-99d2eb84-671b-497c-a8c0-2940a506b064 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1358 microversion: 2.1 time: 0.174932 Sep 01 16:41:07.684934 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 469/902] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:07 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:08.707952 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-2294cd70-98c2-4323-acbb-4496daee397c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:08.709991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-2294cd70-98c2-4323-acbb-4496daee397c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:08.720509 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2294cd70-98c2-4323-acbb-4496daee397c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:08.721003 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2294cd70-98c2-4323-acbb-4496daee397c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:08.721441 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2294cd70-98c2-4323-acbb-4496daee397c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:08.722149 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2294cd70-98c2-4323-acbb-4496daee397c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:08.722663 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2294cd70-98c2-4323-acbb-4496daee397c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:08.723253 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2294cd70-98c2-4323-acbb-4496daee397c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:08.908353 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2294cd70-98c2-4323-acbb-4496daee397c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:08.916953 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-2294cd70-98c2-4323-acbb-4496daee397c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1358 microversion: 2.1 time: 0.215530 Sep 01 16:41:08.923818 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 434/903] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:08 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:09.949168 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3223de5d-2c19-48d1-9287-997d138a2841 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:09.949760 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3223de5d-2c19-48d1-9287-997d138a2841 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:09.965217 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3223de5d-2c19-48d1-9287-997d138a2841 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:09.965217 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3223de5d-2c19-48d1-9287-997d138a2841 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:09.965217 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3223de5d-2c19-48d1-9287-997d138a2841 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:09.965217 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3223de5d-2c19-48d1-9287-997d138a2841 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:09.965606 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3223de5d-2c19-48d1-9287-997d138a2841 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:09.965606 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3223de5d-2c19-48d1-9287-997d138a2841 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:10.116247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3223de5d-2c19-48d1-9287-997d138a2841 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:10.124758 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3223de5d-2c19-48d1-9287-997d138a2841 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1358 microversion: 2.1 time: 0.181076 Sep 01 16:41:10.125330 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 470/904] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:09 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:11.145799 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-527c62a6-0877-494c-ad2f-99c87a438ca0 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:11.146445 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-527c62a6-0877-494c-ad2f-99c87a438ca0 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:11.153723 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-527c62a6-0877-494c-ad2f-99c87a438ca0 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:11.154515 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-527c62a6-0877-494c-ad2f-99c87a438ca0 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:11.155179 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-527c62a6-0877-494c-ad2f-99c87a438ca0 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:11.156052 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-527c62a6-0877-494c-ad2f-99c87a438ca0 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:11.156660 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-527c62a6-0877-494c-ad2f-99c87a438ca0 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:11.157312 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-527c62a6-0877-494c-ad2f-99c87a438ca0 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:11.323454 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-527c62a6-0877-494c-ad2f-99c87a438ca0 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:11.338955 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-527c62a6-0877-494c-ad2f-99c87a438ca0 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1358 microversion: 2.1 time: 0.193243 Sep 01 16:41:11.339683 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 435/905] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:11 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:12.369969 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-08ce22aa-8b9a-44a4-a9a3-2775edc17f2c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:12.371630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-08ce22aa-8b9a-44a4-a9a3-2775edc17f2c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:12.374230 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=6 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:12.380475 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-08ce22aa-8b9a-44a4-a9a3-2775edc17f2c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:12.381233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-08ce22aa-8b9a-44a4-a9a3-2775edc17f2c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:12.381688 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-08ce22aa-8b9a-44a4-a9a3-2775edc17f2c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:12.382678 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-08ce22aa-8b9a-44a4-a9a3-2775edc17f2c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:12.383202 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-08ce22aa-8b9a-44a4-a9a3-2775edc17f2c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:12.383748 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-08ce22aa-8b9a-44a4-a9a3-2775edc17f2c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:12.528818 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-08ce22aa-8b9a-44a4-a9a3-2775edc17f2c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:12.531036 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:12.539060 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-08ce22aa-8b9a-44a4-a9a3-2775edc17f2c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1358 microversion: 2.1 time: 0.173563 Sep 01 16:41:12.539642 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 471/906] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:12 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:13.561016 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-743a6d6c-1327-43b6-a83e-24e7ea45120f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:13.561737 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-743a6d6c-1327-43b6-a83e-24e7ea45120f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:13.563886 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:13.564728 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=6 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:13.575957 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-743a6d6c-1327-43b6-a83e-24e7ea45120f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:13.576442 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-743a6d6c-1327-43b6-a83e-24e7ea45120f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:13.577059 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-743a6d6c-1327-43b6-a83e-24e7ea45120f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:13.577950 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-743a6d6c-1327-43b6-a83e-24e7ea45120f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:13.578430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-743a6d6c-1327-43b6-a83e-24e7ea45120f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:13.578854 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-743a6d6c-1327-43b6-a83e-24e7ea45120f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:14.184922 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-743a6d6c-1327-43b6-a83e-24e7ea45120f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:14.192859 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-743a6d6c-1327-43b6-a83e-24e7ea45120f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1358 microversion: 2.1 time: 0.636522 Sep 01 16:41:14.193637 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 436/907] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:13 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1358 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:15.219891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b9d90e2c-f1f4-4a47-bb5f-3c2cc0530c89 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:15.220619 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b9d90e2c-f1f4-4a47-bb5f-3c2cc0530c89 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:15.228542 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9d90e2c-f1f4-4a47-bb5f-3c2cc0530c89 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:15.228990 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9d90e2c-f1f4-4a47-bb5f-3c2cc0530c89 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:15.229415 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9d90e2c-f1f4-4a47-bb5f-3c2cc0530c89 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:15.230103 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9d90e2c-f1f4-4a47-bb5f-3c2cc0530c89 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:15.230608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9d90e2c-f1f4-4a47-bb5f-3c2cc0530c89 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:15.231025 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9d90e2c-f1f4-4a47-bb5f-3c2cc0530c89 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:15.386680 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b9d90e2c-f1f4-4a47-bb5f-3c2cc0530c89 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:15.394419 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b9d90e2c-f1f4-4a47-bb5f-3c2cc0530c89 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1358 microversion: 2.1 time: 0.178885 Sep 01 16:41:15.394982 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 472/908] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:15 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:16.415927 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f8f9849b-f0b2-47ce-93fd-043061f74cba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:16.416531 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f8f9849b-f0b2-47ce-93fd-043061f74cba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:16.419162 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:16.424625 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f8f9849b-f0b2-47ce-93fd-043061f74cba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:16.425272 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f8f9849b-f0b2-47ce-93fd-043061f74cba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:16.425701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f8f9849b-f0b2-47ce-93fd-043061f74cba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:16.426416 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f8f9849b-f0b2-47ce-93fd-043061f74cba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:16.426857 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f8f9849b-f0b2-47ce-93fd-043061f74cba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:16.427269 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f8f9849b-f0b2-47ce-93fd-043061f74cba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:16.566784 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f8f9849b-f0b2-47ce-93fd-043061f74cba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:16.574872 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f8f9849b-f0b2-47ce-93fd-043061f74cba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1358 microversion: 2.1 time: 0.163002 Sep 01 16:41:16.575435 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 437/909] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:16 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:17.601020 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a288a89a-63f3-4ce4-8104-fc4a46391bf1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:17.601020 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a288a89a-63f3-4ce4-8104-fc4a46391bf1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:17.613390 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a288a89a-63f3-4ce4-8104-fc4a46391bf1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:17.614026 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a288a89a-63f3-4ce4-8104-fc4a46391bf1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:17.614599 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a288a89a-63f3-4ce4-8104-fc4a46391bf1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:17.615411 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a288a89a-63f3-4ce4-8104-fc4a46391bf1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:17.615979 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a288a89a-63f3-4ce4-8104-fc4a46391bf1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:17.616502 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a288a89a-63f3-4ce4-8104-fc4a46391bf1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:17.767647 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a288a89a-63f3-4ce4-8104-fc4a46391bf1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:17.776354 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a288a89a-63f3-4ce4-8104-fc4a46391bf1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1358 microversion: 2.1 time: 0.180408 Sep 01 16:41:17.776855 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 473/910] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:17 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:18.796055 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a38a0f22-f563-4256-b446-5be4426fe5b1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:18.796765 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a38a0f22-f563-4256-b446-5be4426fe5b1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:18.803194 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a38a0f22-f563-4256-b446-5be4426fe5b1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:18.803745 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a38a0f22-f563-4256-b446-5be4426fe5b1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:18.804243 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a38a0f22-f563-4256-b446-5be4426fe5b1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:18.804920 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a38a0f22-f563-4256-b446-5be4426fe5b1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:18.805357 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a38a0f22-f563-4256-b446-5be4426fe5b1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:18.805964 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a38a0f22-f563-4256-b446-5be4426fe5b1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:18.940972 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a38a0f22-f563-4256-b446-5be4426fe5b1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:18.949095 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a38a0f22-f563-4256-b446-5be4426fe5b1 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1358 microversion: 2.1 time: 0.156884 Sep 01 16:41:18.949656 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 438/911] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:18 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:19.170848 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-a152ef22-55a8-4157-9ca9-375e4de7541d req-886106e5-ca36-4ed1-9e64-4abfb0e0e13f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "840b3e8c-3b9a-44ee-8f03-43d332ca8b26", "name": "network-vif-plugged", "status": "completed", "tag": "229f7341-6966-4b67-9657-ed92a6db27a4"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:19.183519 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:19.189494 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-a152ef22-55a8-4157-9ca9-375e4de7541d req-886106e5-ca36-4ed1-9e64-4abfb0e0e13f service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:19.190183 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-a152ef22-55a8-4157-9ca9-375e4de7541d req-886106e5-ca36-4ed1-9e64-4abfb0e0e13f service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:19.190788 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-a152ef22-55a8-4157-9ca9-375e4de7541d req-886106e5-ca36-4ed1-9e64-4abfb0e0e13f service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:19.204674 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-a152ef22-55a8-4157-9ca9-375e4de7541d req-886106e5-ca36-4ed1-9e64-4abfb0e0e13f service nova] Creating event network-vif-plugged:229f7341-6966-4b67-9657-ed92a6db27a4 for instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 on hv-cinder-85220 Sep 01 16:41:19.209804 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-a152ef22-55a8-4157-9ca9-375e4de7541d req-886106e5-ca36-4ed1-9e64-4abfb0e0e13f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042790 Sep 01 16:41:19.210436 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 474/912] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:19.971285 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-687734a4-5b13-41ef-8d2b-cd39e2465fbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:19.971909 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-687734a4-5b13-41ef-8d2b-cd39e2465fbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:19.979225 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-687734a4-5b13-41ef-8d2b-cd39e2465fbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:19.979695 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-687734a4-5b13-41ef-8d2b-cd39e2465fbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:19.980119 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-687734a4-5b13-41ef-8d2b-cd39e2465fbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:19.980790 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-687734a4-5b13-41ef-8d2b-cd39e2465fbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:19.981248 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-687734a4-5b13-41ef-8d2b-cd39e2465fbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:19.981668 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-687734a4-5b13-41ef-8d2b-cd39e2465fbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:20.115542 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-687734a4-5b13-41ef-8d2b-cd39e2465fbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:20.124371 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-687734a4-5b13-41ef-8d2b-cd39e2465fbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1358 microversion: 2.1 time: 0.155823 Sep 01 16:41:20.124943 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 439/913] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:19 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:21.148804 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-04201f8a-a7d0-4293-a906-2f0a9c33cba8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:21.149637 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-04201f8a-a7d0-4293-a906-2f0a9c33cba8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:21.156039 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-04201f8a-a7d0-4293-a906-2f0a9c33cba8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.156516 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-04201f8a-a7d0-4293-a906-2f0a9c33cba8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.156946 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-04201f8a-a7d0-4293-a906-2f0a9c33cba8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.157631 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-04201f8a-a7d0-4293-a906-2f0a9c33cba8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.158078 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-04201f8a-a7d0-4293-a906-2f0a9c33cba8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.158538 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-04201f8a-a7d0-4293-a906-2f0a9c33cba8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.297351 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-04201f8a-a7d0-4293-a906-2f0a9c33cba8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:21.305192 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-04201f8a-a7d0-4293-a906-2f0a9c33cba8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1548 microversion: 2.1 time: 0.161409 Sep 01 16:41:21.305753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 475/914] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:21 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:21.327771 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-2d476756-051d-4993-b4b3-73845d9d9e8e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:21.328458 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-2d476756-051d-4993-b4b3-73845d9d9e8e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:21.335265 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2d476756-051d-4993-b4b3-73845d9d9e8e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.335742 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2d476756-051d-4993-b4b3-73845d9d9e8e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.336167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2d476756-051d-4993-b4b3-73845d9d9e8e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.336855 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2d476756-051d-4993-b4b3-73845d9d9e8e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.337330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2d476756-051d-4993-b4b3-73845d9d9e8e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.337747 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2d476756-051d-4993-b4b3-73845d9d9e8e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.471212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2d476756-051d-4993-b4b3-73845d9d9e8e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:21.480135 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-2d476756-051d-4993-b4b3-73845d9d9e8e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1548 microversion: 2.1 time: 0.157194 Sep 01 16:41:21.480711 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 440/915] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:21 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:21.499947 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bc730d55-2a27-4985-9531-0b57b2532c9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:21.504767 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bc730d55-2a27-4985-9531-0b57b2532c9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:21.505530 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bc730d55-2a27-4985-9531-0b57b2532c9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Searching by: {'deleted': False, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c'} {{(pid=127177) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 16:41:21.512696 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc730d55-2a27-4985-9531-0b57b2532c9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.513171 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc730d55-2a27-4985-9531-0b57b2532c9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.513601 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc730d55-2a27-4985-9531-0b57b2532c9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.514348 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc730d55-2a27-4985-9531-0b57b2532c9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.514801 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc730d55-2a27-4985-9531-0b57b2532c9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.515226 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc730d55-2a27-4985-9531-0b57b2532c9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.607186 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.multi_cell_list [None req-bc730d55-2a27-4985-9531-0b57b2532c9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127177) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 16:41:21.706087 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bc730d55-2a27-4985-9531-0b57b2532c9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.209810 Sep 01 16:41:21.706753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 476/916] 10.222.0.18 () {58 vars in 1125 bytes} [Thu Sep 1 16:41:21 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:21.718418 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-38d05238-9b1d-4c91-b0d7-19878b02e6be tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:21.719014 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-38d05238-9b1d-4c91-b0d7-19878b02e6be tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:21.724978 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-38d05238-9b1d-4c91-b0d7-19878b02e6be tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.725452 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-38d05238-9b1d-4c91-b0d7-19878b02e6be tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.725877 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-38d05238-9b1d-4c91-b0d7-19878b02e6be tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.726833 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-38d05238-9b1d-4c91-b0d7-19878b02e6be tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.727280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-38d05238-9b1d-4c91-b0d7-19878b02e6be tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.727695 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-38d05238-9b1d-4c91-b0d7-19878b02e6be tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.856605 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-38d05238-9b1d-4c91-b0d7-19878b02e6be tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:21.864509 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-38d05238-9b1d-4c91-b0d7-19878b02e6be tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1548 microversion: 2.1 time: 0.149843 Sep 01 16:41:21.865081 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 441/917] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:21 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:23.412705 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2cd7c826-9f4d-4c56-92b9-7e4c0d95ff9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8baf7fb2-12d8-4296-9e7d-4e462c968309"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:23.415043 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2cd7c826-9f4d-4c56-92b9-7e4c0d95ff9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:23.421886 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cd7c826-9f4d-4c56-92b9-7e4c0d95ff9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:23.422384 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cd7c826-9f4d-4c56-92b9-7e4c0d95ff9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:23.422810 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cd7c826-9f4d-4c56-92b9-7e4c0d95ff9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:23.423480 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cd7c826-9f4d-4c56-92b9-7e4c0d95ff9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:23.423922 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cd7c826-9f4d-4c56-92b9-7e4c0d95ff9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:23.424337 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cd7c826-9f4d-4c56-92b9-7e4c0d95ff9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:23.701959 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2cd7c826-9f4d-4c56-92b9-7e4c0d95ff9e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "POST /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293125 Sep 01 16:41:23.702995 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 477/918] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 1 16:41:23 2022] POST /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:41:25.235173 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-9de19645-9dbe-49c6-9f13-44ff4174fead tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:25.237442 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-9de19645-9dbe-49c6-9f13-44ff4174fead tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:25.244491 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9de19645-9dbe-49c6-9f13-44ff4174fead tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:25.244965 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9de19645-9dbe-49c6-9f13-44ff4174fead tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:25.245409 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9de19645-9dbe-49c6-9f13-44ff4174fead tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:25.246147 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9de19645-9dbe-49c6-9f13-44ff4174fead tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:25.246627 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9de19645-9dbe-49c6-9f13-44ff4174fead tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:25.247052 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9de19645-9dbe-49c6-9f13-44ff4174fead tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:25.249503 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=69 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:25.278224 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-9de19645-9dbe-49c6-9f13-44ff4174fead tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047006 Sep 01 16:41:25.278875 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 442/919] 10.222.0.18 () {60 vars in 1343 bytes} [Thu Sep 1 16:41:25 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:25.341708 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8b730e08-d02d-4244-a6ae-9b5598c8e521 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:25.342304 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8b730e08-d02d-4244-a6ae-9b5598c8e521 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:25.348698 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b730e08-d02d-4244-a6ae-9b5598c8e521 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:25.349171 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b730e08-d02d-4244-a6ae-9b5598c8e521 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:25.349616 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b730e08-d02d-4244-a6ae-9b5598c8e521 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:25.350544 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b730e08-d02d-4244-a6ae-9b5598c8e521 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:25.350994 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b730e08-d02d-4244-a6ae-9b5598c8e521 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:25.351664 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b730e08-d02d-4244-a6ae-9b5598c8e521 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:25.377656 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8b730e08-d02d-4244-a6ae-9b5598c8e521 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:41:25.455799 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8b730e08-d02d-4244-a6ae-9b5598c8e521 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 204 len: 0 microversion: 2.20 time: 0.118921 Sep 01 16:41:25.456493 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 478/920] 10.222.0.18 () {60 vars in 1280 bytes} [Thu Sep 1 16:41:25 2022] DELETE /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 16:41:25.465339 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-2ab8a3aa-5504-48dc-8004-856f696784ae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:25.465942 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-2ab8a3aa-5504-48dc-8004-856f696784ae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:25.471951 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2ab8a3aa-5504-48dc-8004-856f696784ae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:25.472426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2ab8a3aa-5504-48dc-8004-856f696784ae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:25.472858 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2ab8a3aa-5504-48dc-8004-856f696784ae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:25.473537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2ab8a3aa-5504-48dc-8004-856f696784ae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:25.473984 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2ab8a3aa-5504-48dc-8004-856f696784ae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:25.474433 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2ab8a3aa-5504-48dc-8004-856f696784ae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:25.610556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2ab8a3aa-5504-48dc-8004-856f696784ae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:25.618752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2ab8a3aa-5504-48dc-8004-856f696784ae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:25.620087 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2ab8a3aa-5504-48dc-8004-856f696784ae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:25.621236 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-2ab8a3aa-5504-48dc-8004-856f696784ae tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1724 microversion: 2.20 time: 0.160420 Sep 01 16:41:25.621801 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 443/921] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:25 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:26.646176 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c20a04ec-1a11-481d-b7a1-550a8665a3ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:26.646957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c20a04ec-1a11-481d-b7a1-550a8665a3ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:26.653535 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c20a04ec-1a11-481d-b7a1-550a8665a3ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:26.654020 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c20a04ec-1a11-481d-b7a1-550a8665a3ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:26.654487 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c20a04ec-1a11-481d-b7a1-550a8665a3ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:26.655198 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c20a04ec-1a11-481d-b7a1-550a8665a3ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:26.655679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c20a04ec-1a11-481d-b7a1-550a8665a3ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:26.656098 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c20a04ec-1a11-481d-b7a1-550a8665a3ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:26.795262 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c20a04ec-1a11-481d-b7a1-550a8665a3ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:26.803531 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c20a04ec-1a11-481d-b7a1-550a8665a3ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:26.804992 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c20a04ec-1a11-481d-b7a1-550a8665a3ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:26.806777 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c20a04ec-1a11-481d-b7a1-550a8665a3ce tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1724 microversion: 2.20 time: 0.164996 Sep 01 16:41:26.807338 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 479/922] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:26 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:27.830334 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-956a5cc8-c067-4a0b-8c19-d6ff37380fb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:27.830908 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-956a5cc8-c067-4a0b-8c19-d6ff37380fb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:27.837925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-956a5cc8-c067-4a0b-8c19-d6ff37380fb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:27.838423 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-956a5cc8-c067-4a0b-8c19-d6ff37380fb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:27.838848 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-956a5cc8-c067-4a0b-8c19-d6ff37380fb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:27.839528 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-956a5cc8-c067-4a0b-8c19-d6ff37380fb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:27.839970 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-956a5cc8-c067-4a0b-8c19-d6ff37380fb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:27.840384 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-956a5cc8-c067-4a0b-8c19-d6ff37380fb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:27.913348 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-956a5cc8-c067-4a0b-8c19-d6ff37380fb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:27.921711 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-956a5cc8-c067-4a0b-8c19-d6ff37380fb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:27.923173 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-956a5cc8-c067-4a0b-8c19-d6ff37380fb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8388303f9098497bb559b3bcb59fab52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb0b630e22745e8af15fb02c71800c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:27.924324 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-956a5cc8-c067-4a0b-8c19-d6ff37380fb0 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 200 len: 1657 microversion: 2.20 time: 0.097893 Sep 01 16:41:27.925275 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 444/923] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:27 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 1657 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:28.093059 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-dcc4f814-8e88-45dd-b448-a840ac57cdde req-e5267669-82c3-4373-b23d-0a13baa388a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d764e51-5b8a-4d17-886e-b52189448293", "name": "network-vif-deleted", "tag": "5bb9e1c4-5809-406a-8024-a9bfe99bb842"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:28.105940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-dcc4f814-8e88-45dd-b448-a840ac57cdde req-e5267669-82c3-4373-b23d-0a13baa388a0 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:28.106447 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-dcc4f814-8e88-45dd-b448-a840ac57cdde req-e5267669-82c3-4373-b23d-0a13baa388a0 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:28.106872 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-dcc4f814-8e88-45dd-b448-a840ac57cdde req-e5267669-82c3-4373-b23d-0a13baa388a0 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:28.119356 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-dcc4f814-8e88-45dd-b448-a840ac57cdde req-e5267669-82c3-4373-b23d-0a13baa388a0 service nova] Creating event network-vif-deleted:5bb9e1c4-5809-406a-8024-a9bfe99bb842 for instance 7d764e51-5b8a-4d17-886e-b52189448293 on hv-cinder-85220 Sep 01 16:41:28.124914 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-dcc4f814-8e88-45dd-b448-a840ac57cdde req-e5267669-82c3-4373-b23d-0a13baa388a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035525 Sep 01 16:41:28.126087 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 480/924] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:28.948530 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-82b0d544-f38c-452d-b013-927f9bca4477 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:28.949136 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-82b0d544-f38c-452d-b013-927f9bca4477 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:28.956100 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-82b0d544-f38c-452d-b013-927f9bca4477 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:28.956687 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-82b0d544-f38c-452d-b013-927f9bca4477 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:28.957230 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-82b0d544-f38c-452d-b013-927f9bca4477 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:28.958115 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-82b0d544-f38c-452d-b013-927f9bca4477 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:28.958616 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-82b0d544-f38c-452d-b013-927f9bca4477 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:28.959041 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-82b0d544-f38c-452d-b013-927f9bca4477 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:28.973563 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-82b0d544-f38c-452d-b013-927f9bca4477 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] HTTP exception thrown: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-82b0d544-f38c-452d-b013-927f9bca4477 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Request method failure captured: Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 HTTP/1.1 Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN79ERR9fLbUahRSJk7hXfL4HJawIv21RX2LwoCzw1DEFNoHcT34R9AsgzMn4RQvNl33D6y-6Frlt-3D3AT2ZfUvg-AFa7Wzdy028iI5B1c-4YbxoBqt6o1jOGMNwJNkUd1i7gMBmqBTOGuupVNlC3UrybOQMhnYiBkYv1-EQ8x2DyI Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: cfb0b630e22745e8af15fb02c71800c3 Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:41:28.975282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:41:28.977280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:41:28.977280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:41:28.977280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: cfb0b630e22745e8af15fb02c71800c3 Sep 01 16:41:28.977280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:41:28.977280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-AttachVolumeShelveTestJSON-1886242538-project Sep 01 16:41:28.977280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:41:28.977280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:41:28.977280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: 8388303f9098497bb559b3bcb59fab52 Sep 01 16:41:28.977280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1886242538-project Sep 01 16:41:28.977280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:41:28.977280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. Sep 01 16:41:28.977280 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': '7d764e51-5b8a-4d17-886e-b52189448293'} Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:28.978949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. Sep 01 16:41:28.980585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:41:28.982111 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-82b0d544-f38c-452d-b013-927f9bca4477 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Returning 404 to user: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:28.982111 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-82b0d544-f38c-452d-b013-927f9bca4477 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 404 len: 111 microversion: 2.20 time: 0.032466 Sep 01 16:41:28.982111 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 445/925] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:28 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:41:28.991384 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-72319e7c-e170-41cf-8c2c-482f36b7871d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '.version_select at 0x7feeec18c9d0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:29.010922 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-72319e7c-e170-41cf-8c2c-482f36b7871d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1369706642" status: 204 len: 0 microversion: 2.20 time: 0.024554 Sep 01 16:41:29.011507 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 481/926] 10.222.0.18 () {60 vars in 1262 bytes} [Thu Sep 1 16:41:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1369706642 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 16:41:30.809404 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a3d6f1c2-88c6-4411-965b-72f50c41576e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:30.809974 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a3d6f1c2-88c6-4411-965b-72f50c41576e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:30.816537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a3d6f1c2-88c6-4411-965b-72f50c41576e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.817015 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a3d6f1c2-88c6-4411-965b-72f50c41576e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.817446 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a3d6f1c2-88c6-4411-965b-72f50c41576e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.818129 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a3d6f1c2-88c6-4411-965b-72f50c41576e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.818602 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a3d6f1c2-88c6-4411-965b-72f50c41576e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.819023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a3d6f1c2-88c6-4411-965b-72f50c41576e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.833172 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-a3d6f1c2-88c6-4411-965b-72f50c41576e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] HTTP exception thrown: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a3d6f1c2-88c6-4411-965b-72f50c41576e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Request method failure captured: Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: DELETE /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 HTTP/1.1 Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN79ERR9fLbUahRSJk7hXfL4HJawIv21RX2LwoCzw1DEFNoHcT34R9AsgzMn4RQvNl33D6y-6Frlt-3D3AT2ZfUvg-AFa7Wzdy028iI5B1c-4YbxoBqt6o1jOGMNwJNkUd1i7gMBmqBTOGuupVNlC3UrybOQMhnYiBkYv1-EQ8x2DyI Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: cfb0b630e22745e8af15fb02c71800c3 Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:41:30.834751 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:41:30.836327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:41:30.836327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:41:30.836327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: cfb0b630e22745e8af15fb02c71800c3 Sep 01 16:41:30.836327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:41:30.836327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-AttachVolumeShelveTestJSON-1886242538-project Sep 01 16:41:30.836327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:41:30.836327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:41:30.836327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: 8388303f9098497bb559b3bcb59fab52 Sep 01 16:41:30.836327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1886242538-project Sep 01 16:41:30.836327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:41:30.836327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. Sep 01 16:41:30.836327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': '7d764e51-5b8a-4d17-886e-b52189448293'} Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:30.837850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. Sep 01 16:41:30.839330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:41:30.840869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a3d6f1c2-88c6-4411-965b-72f50c41576e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Returning 404 to user: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:30.840869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a3d6f1c2-88c6-4411-965b-72f50c41576e tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 404 len: 111 microversion: 2.20 time: 0.030667 Sep 01 16:41:30.840869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 446/927] 10.222.0.18 () {60 vars in 1280 bytes} [Thu Sep 1 16:41:30 2022] DELETE /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:41:30.845586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-343ad3fb-1a56-4ad4-9312-dfa4a8d47615 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:30.846331 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-343ad3fb-1a56-4ad4-9312-dfa4a8d47615 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 7d764e51-5b8a-4d17-886e-b52189448293] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:30.853414 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-343ad3fb-1a56-4ad4-9312-dfa4a8d47615 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.853897 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-343ad3fb-1a56-4ad4-9312-dfa4a8d47615 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.854354 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-343ad3fb-1a56-4ad4-9312-dfa4a8d47615 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.855041 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-343ad3fb-1a56-4ad4-9312-dfa4a8d47615 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.855489 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-343ad3fb-1a56-4ad4-9312-dfa4a8d47615 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.855904 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-343ad3fb-1a56-4ad4-9312-dfa4a8d47615 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.869018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-343ad3fb-1a56-4ad4-9312-dfa4a8d47615 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] HTTP exception thrown: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-343ad3fb-1a56-4ad4-9312-dfa4a8d47615 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Request method failure captured: Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 HTTP/1.1 Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN79ERR9fLbUahRSJk7hXfL4HJawIv21RX2LwoCzw1DEFNoHcT34R9AsgzMn4RQvNl33D6y-6Frlt-3D3AT2ZfUvg-AFa7Wzdy028iI5B1c-4YbxoBqt6o1jOGMNwJNkUd1i7gMBmqBTOGuupVNlC3UrybOQMhnYiBkYv1-EQ8x2DyI Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: cfb0b630e22745e8af15fb02c71800c3 Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:41:30.870586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:41:30.872190 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:41:30.872190 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:41:30.872190 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: cfb0b630e22745e8af15fb02c71800c3 Sep 01 16:41:30.872190 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:41:30.872190 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeShelveTestJSON-1886242538-project Sep 01 16:41:30.872190 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:41:30.872190 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:41:30.872190 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: 8388303f9098497bb559b3bcb59fab52 Sep 01 16:41:30.872190 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1886242538-project Sep 01 16:41:30.872190 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:41:30.872190 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. Sep 01 16:41:30.872190 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': '7d764e51-5b8a-4d17-886e-b52189448293'} Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:30.873204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. Sep 01 16:41:30.874675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:41:30.876009 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-343ad3fb-1a56-4ad4-9312-dfa4a8d47615 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Returning 404 to user: Instance 7d764e51-5b8a-4d17-886e-b52189448293 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:30.876009 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-343ad3fb-1a56-4ad4-9312-dfa4a8d47615 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293" status: 404 len: 111 microversion: 2.20 time: 0.030784 Sep 01 16:41:30.876009 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 482/928] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:30 2022] GET /compute/v2.1/servers/7d764e51-5b8a-4d17-886e-b52189448293 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:41:31.303952 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-eece3143-93b6-45a5-820c-fe4b1aefa30d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:31.304776 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-eece3143-93b6-45a5-820c-fe4b1aefa30d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:31.311156 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eece3143-93b6-45a5-820c-fe4b1aefa30d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:31.311628 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eece3143-93b6-45a5-820c-fe4b1aefa30d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:31.312053 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eece3143-93b6-45a5-820c-fe4b1aefa30d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:31.312720 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eece3143-93b6-45a5-820c-fe4b1aefa30d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:31.313160 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eece3143-93b6-45a5-820c-fe4b1aefa30d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:31.313577 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eece3143-93b6-45a5-820c-fe4b1aefa30d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:31.450437 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-eece3143-93b6-45a5-820c-fe4b1aefa30d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:31.459697 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-eece3143-93b6-45a5-820c-fe4b1aefa30d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1594 microversion: 2.1 time: 0.159318 Sep 01 16:41:31.460537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 447/929] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:31 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:32.010143 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-088685f5-8895-477e-8522-16f38944d3c8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:32.010662 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-088685f5-8895-477e-8522-16f38944d3c8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:32.012605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:32.018359 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-088685f5-8895-477e-8522-16f38944d3c8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:32.018835 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-088685f5-8895-477e-8522-16f38944d3c8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:32.019272 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-088685f5-8895-477e-8522-16f38944d3c8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:32.019958 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-088685f5-8895-477e-8522-16f38944d3c8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:32.020437 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-088685f5-8895-477e-8522-16f38944d3c8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:32.021055 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-088685f5-8895-477e-8522-16f38944d3c8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:32.035177 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-088685f5-8895-477e-8522-16f38944d3c8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] HTTP exception thrown: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-088685f5-8895-477e-8522-16f38944d3c8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Request method failure captured: Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: DELETE /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f HTTP/1.1 Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN79ERR9fLbUahRSJk7hXfL4HJawIv21RX2LwoCzw1DEFNoHcT34R9AsgzMn4RQvNl33D6y-6Frlt-3D3AT2ZfUvg-AFa7Wzdy028iI5B1c-4YbxoBqt6o1jOGMNwJNkUd1i7gMBmqBTOGuupVNlC3UrybOQMhnYiBkYv1-EQ8x2DyI Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: cfb0b630e22745e8af15fb02c71800c3 Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:41:32.036719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:41:32.038366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:41:32.038366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:41:32.038366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: cfb0b630e22745e8af15fb02c71800c3 Sep 01 16:41:32.038366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:41:32.038366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeShelveTestJSON-1886242538-project Sep 01 16:41:32.038366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:41:32.038366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:41:32.038366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: 8388303f9098497bb559b3bcb59fab52 Sep 01 16:41:32.038366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1886242538-project Sep 01 16:41:32.038366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:41:32.038366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. Sep 01 16:41:32.038366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': '0958ba3f-7f1d-4fa1-bff7-4459d3945b6f'} Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:32.042838 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. Sep 01 16:41:32.044236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:41:32.045751 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-088685f5-8895-477e-8522-16f38944d3c8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Returning 404 to user: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:32.045751 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-088685f5-8895-477e-8522-16f38944d3c8 tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 404 len: 111 microversion: 2.20 time: 0.031880 Sep 01 16:41:32.045751 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 483/930] 10.222.0.18 () {60 vars in 1280 bytes} [Thu Sep 1 16:41:32 2022] DELETE /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 16:41:32.047582 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-018d419d-a5af-49ad-ab11-c17dce6ec76d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:32.048190 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-018d419d-a5af-49ad-ab11-c17dce6ec76d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] [instance: 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:32.054540 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-018d419d-a5af-49ad-ab11-c17dce6ec76d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:32.055022 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-018d419d-a5af-49ad-ab11-c17dce6ec76d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:32.055743 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-018d419d-a5af-49ad-ab11-c17dce6ec76d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:32.056195 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-018d419d-a5af-49ad-ab11-c17dce6ec76d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:32.056624 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-018d419d-a5af-49ad-ab11-c17dce6ec76d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:32.057046 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-018d419d-a5af-49ad-ab11-c17dce6ec76d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:32.070495 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-018d419d-a5af-49ad-ab11-c17dce6ec76d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] HTTP exception thrown: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-018d419d-a5af-49ad-ab11-c17dce6ec76d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Request method failure captured: Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f HTTP/1.1 Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN79ERR9fLbUahRSJk7hXfL4HJawIv21RX2LwoCzw1DEFNoHcT34R9AsgzMn4RQvNl33D6y-6Frlt-3D3AT2ZfUvg-AFa7Wzdy028iI5B1c-4YbxoBqt6o1jOGMNwJNkUd1i7gMBmqBTOGuupVNlC3UrybOQMhnYiBkYv1-EQ8x2DyI Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: cfb0b630e22745e8af15fb02c71800c3 Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:41:32.071998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:41:32.073369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfb0b630e22745e8af15fb02c71800c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:41:32.073369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:41:32.073369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: cfb0b630e22745e8af15fb02c71800c3 Sep 01 16:41:32.073369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1886242538 Sep 01 16:41:32.073369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-AttachVolumeShelveTestJSON-1886242538-project Sep 01 16:41:32.073369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:41:32.073369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:41:32.073369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: 8388303f9098497bb559b3bcb59fab52 Sep 01 16:41:32.073369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1886242538-project Sep 01 16:41:32.073369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:41:32.073369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. Sep 01 16:41:32.073369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': '0958ba3f-7f1d-4fa1-bff7-4459d3945b6f'} Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:32.074079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. Sep 01 16:41:32.075391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:41:32.076576 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-018d419d-a5af-49ad-ab11-c17dce6ec76d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] Returning 404 to user: Instance 0958ba3f-7f1d-4fa1-bff7-4459d3945b6f could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:32.076576 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-018d419d-a5af-49ad-ab11-c17dce6ec76d tempest-AttachVolumeShelveTestJSON-1886242538 tempest-AttachVolumeShelveTestJSON-1886242538-project] 10.222.0.18 "GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f" status: 404 len: 111 microversion: 2.20 time: 0.029611 Sep 01 16:41:32.076576 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 448/931] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:32 2022] GET /compute/v2.1/servers/0958ba3f-7f1d-4fa1-bff7-4459d3945b6f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 16:41:33.192999 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-4430aed6-99a8-4a26-b677-704954894c2a req-2b119bcc-87fc-48e9-97c2-0a146dc75983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840b3e8c-3b9a-44ee-8f03-43d332ca8b26", "tag": "229f7341-6966-4b67-9657-ed92a6db27a4"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:33.215338 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-4430aed6-99a8-4a26-b677-704954894c2a req-2b119bcc-87fc-48e9-97c2-0a146dc75983 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:33.215613 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-4430aed6-99a8-4a26-b677-704954894c2a req-2b119bcc-87fc-48e9-97c2-0a146dc75983 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:33.217072 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-4430aed6-99a8-4a26-b677-704954894c2a req-2b119bcc-87fc-48e9-97c2-0a146dc75983 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:33.243492 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-4430aed6-99a8-4a26-b677-704954894c2a req-2b119bcc-87fc-48e9-97c2-0a146dc75983 service nova] Creating event network-changed:229f7341-6966-4b67-9657-ed92a6db27a4 for instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 on hv-cinder-85220 Sep 01 16:41:33.248926 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-4430aed6-99a8-4a26-b677-704954894c2a req-2b119bcc-87fc-48e9-97c2-0a146dc75983 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059774 Sep 01 16:41:33.250079 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 484/932] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:34.968980 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-61bbdd89-3d7f-4735-ad47-d1cdcdbbb22d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1212051678"}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:34.969838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-61bbdd89-3d7f-4735-ad47-d1cdcdbbb22d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:34.977135 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-61bbdd89-3d7f-4735-ad47-d1cdcdbbb22d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:34.978287 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-61bbdd89-3d7f-4735-ad47-d1cdcdbbb22d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:34.983703 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-61bbdd89-3d7f-4735-ad47-d1cdcdbbb22d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:34.984571 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-61bbdd89-3d7f-4735-ad47-d1cdcdbbb22d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:34.985122 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-61bbdd89-3d7f-4735-ad47-d1cdcdbbb22d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:34.985633 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-61bbdd89-3d7f-4735-ad47-d1cdcdbbb22d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:35.123827 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.network.security_group_api [None req-61bbdd89-3d7f-4735-ad47-d1cdcdbbb22d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Adding security group 540127ec-4e23-4f73-a15d-88ab904e2328 to port 229f7341-6966-4b67-9657-ed92a6db27a4 Sep 01 16:41:35.521723 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-61bbdd89-3d7f-4735-ad47-d1cdcdbbb22d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "POST /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/action" status: 202 len: 0 microversion: 2.1 time: 0.556556 Sep 01 16:41:35.524943 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 449/933] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 1 16:41:34 2022] POST /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:41:35.532623 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ba488a54-c0aa-4bed-ac06-0612ec693976 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:35.533473 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ba488a54-c0aa-4bed-ac06-0612ec693976 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:35.545128 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ba488a54-c0aa-4bed-ac06-0612ec693976 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:35.552283 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ba488a54-c0aa-4bed-ac06-0612ec693976 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:35.553370 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ba488a54-c0aa-4bed-ac06-0612ec693976 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:35.555972 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ba488a54-c0aa-4bed-ac06-0612ec693976 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:35.556109 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-621f31c6-84e9-4f82-bc4c-4cd0b9ba7c0e req-985780f3-bda7-4d19-a47f-f56c5066a171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840b3e8c-3b9a-44ee-8f03-43d332ca8b26", "tag": "229f7341-6966-4b67-9657-ed92a6db27a4"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:35.558657 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ba488a54-c0aa-4bed-ac06-0612ec693976 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:35.559856 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ba488a54-c0aa-4bed-ac06-0612ec693976 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:35.572413 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-621f31c6-84e9-4f82-bc4c-4cd0b9ba7c0e req-985780f3-bda7-4d19-a47f-f56c5066a171 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:35.575536 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-621f31c6-84e9-4f82-bc4c-4cd0b9ba7c0e req-985780f3-bda7-4d19-a47f-f56c5066a171 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:35.578770 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-621f31c6-84e9-4f82-bc4c-4cd0b9ba7c0e req-985780f3-bda7-4d19-a47f-f56c5066a171 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:35.602088 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-621f31c6-84e9-4f82-bc4c-4cd0b9ba7c0e req-985780f3-bda7-4d19-a47f-f56c5066a171 service nova] Creating event network-changed:229f7341-6966-4b67-9657-ed92a6db27a4 for instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 on hv-cinder-85220 Sep 01 16:41:35.615873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-621f31c6-84e9-4f82-bc4c-4cd0b9ba7c0e req-985780f3-bda7-4d19-a47f-f56c5066a171 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064769 Sep 01 16:41:35.617437 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 450/934] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:35.852981 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ba488a54-c0aa-4bed-ac06-0612ec693976 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:35.865222 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ba488a54-c0aa-4bed-ac06-0612ec693976 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1759 microversion: 2.1 time: 0.335845 Sep 01 16:41:35.865586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 485/935] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:35 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1759 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:41.773096 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-fe6bccf5-a3ff-455a-b260-e3c5c7f810b2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Action: 'create', calling method: .version_select at 0x7feeec08fee0>, body: {"keypair": {"name": "tempest-keypair-1097885945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFqlnCoGKCOnSxKpQpv2x2V4cV39G+FgBJSm+edl4o54FJ9C2xsXMxwB1My/plkxKLMNwlsezSWqY3IGi/byyiOngmuM4QN5JIFvBDjXJ+jXlxbcIT2Q9PIBYiNGSBbIQ=="}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:41.794207 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-fe6bccf5-a3ff-455a-b260-e3c5c7f810b2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Getting quotas for project 9b9aa20e1ffb453d9ee13dd6ae2c25ef. Resources: {'key_pairs'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:41:41.798408 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-fe6bccf5-a3ff-455a-b260-e3c5c7f810b2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Getting quotas for user a237b400429f4200909581e3c5e0cbfb and project 9b9aa20e1ffb453d9ee13dd6ae2c25ef. Resources: {'key_pairs'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:41:41.825951 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-fe6bccf5-a3ff-455a-b260-e3c5c7f810b2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.223726 Sep 01 16:41:41.826594 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 451/936] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 1 16:41:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:41:43.229396 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1382914678", "imageRef": "46185d58-0d47-4c97-b590-0f4434aa5c9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae0395ee-74d9-4949-89c6-cf6ebc736a46"}], "security_groups": [{"name": "tempest-securitygroup--1260141181"}], "key_name": "tempest-keypair-1097885945", "user_data": "}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:43.351940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] validate_networks() for [('ae0395ee-74d9-4949-89c6-cf6ebc736a46', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:41:43.778549 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:41:43.779034 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:41:43.779610 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:41:43.780120 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:41:43.780587 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:41:43.793701 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:43.794186 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:43.794649 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:43.795927 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:43.795927 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:43.796472 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:43.815214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Getting quotas for project 9b9aa20e1ffb453d9ee13dd6ae2c25ef. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:41:43.820070 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Getting quotas for user a237b400429f4200909581e3c5e0cbfb and project 9b9aa20e1ffb453d9ee13dd6ae2c25ef. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:41:43.832932 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:41:43.835869 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46185d58-0d47-4c97-b590-0f4434aa5c9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:41:43.910269 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3e8fe2bf-b110-492b-827f-56fadb23c9d2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.682735 Sep 01 16:41:43.910269 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 486/937] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:41:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:41:43.912769 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f3145204-6ce1-4a19-a24e-efb826d42c63 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:43.913507 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f3145204-6ce1-4a19-a24e-efb826d42c63 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:43.969817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f3145204-6ce1-4a19-a24e-efb826d42c63 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:43.978581 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f3145204-6ce1-4a19-a24e-efb826d42c63 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff" status: 200 len: 1242 microversion: 2.1 time: 0.070202 Sep 01 16:41:43.979148 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 452/938] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:43 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:45.000127 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-fbccc769-2b11-4c6c-a495-4a9f7686eb0c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:45.001487 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-fbccc769-2b11-4c6c-a495-4a9f7686eb0c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:45.009496 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbccc769-2b11-4c6c-a495-4a9f7686eb0c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:45.010008 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbccc769-2b11-4c6c-a495-4a9f7686eb0c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:45.010490 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbccc769-2b11-4c6c-a495-4a9f7686eb0c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:45.011601 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbccc769-2b11-4c6c-a495-4a9f7686eb0c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:45.012255 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbccc769-2b11-4c6c-a495-4a9f7686eb0c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:45.012846 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbccc769-2b11-4c6c-a495-4a9f7686eb0c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:45.103893 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-fbccc769-2b11-4c6c-a495-4a9f7686eb0c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:45.113957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-fbccc769-2b11-4c6c-a495-4a9f7686eb0c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff" status: 200 len: 1294 microversion: 2.1 time: 0.118668 Sep 01 16:41:45.114913 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 487/939] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:44 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff => generated 1294 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:46.136558 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c464e997-1658-4b59-ac37-2b57830d9215 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:46.137200 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c464e997-1658-4b59-ac37-2b57830d9215 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:46.139855 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=35 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:46.146358 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c464e997-1658-4b59-ac37-2b57830d9215 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:46.146848 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c464e997-1658-4b59-ac37-2b57830d9215 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:46.147285 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c464e997-1658-4b59-ac37-2b57830d9215 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:46.147982 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c464e997-1658-4b59-ac37-2b57830d9215 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:46.148460 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c464e997-1658-4b59-ac37-2b57830d9215 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:46.149411 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c464e997-1658-4b59-ac37-2b57830d9215 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:46.222016 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c464e997-1658-4b59-ac37-2b57830d9215 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:46.230549 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c464e997-1658-4b59-ac37-2b57830d9215 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff" status: 200 len: 1300 microversion: 2.1 time: 0.098074 Sep 01 16:41:46.231141 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 453/940] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:46 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:47.055748 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-def111d0-bc27-454c-a681-999a40d485a2 req-f46a86be-9170-44c5-866b-433b30436d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "870a289a-9e2c-4471-ac02-f9aa77461aff", "tag": "75ac0e1d-9e18-472b-a40c-6d01c150b883"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:47.066198 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-def111d0-bc27-454c-a681-999a40d485a2 req-f46a86be-9170-44c5-866b-433b30436d89 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:47.066774 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-def111d0-bc27-454c-a681-999a40d485a2 req-f46a86be-9170-44c5-866b-433b30436d89 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:47.067251 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-def111d0-bc27-454c-a681-999a40d485a2 req-f46a86be-9170-44c5-866b-433b30436d89 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:47.070485 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:47.087759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-def111d0-bc27-454c-a681-999a40d485a2 req-f46a86be-9170-44c5-866b-433b30436d89 service nova] Creating event network-changed:75ac0e1d-9e18-472b-a40c-6d01c150b883 for instance 870a289a-9e2c-4471-ac02-f9aa77461aff on hv-cinder-85220 Sep 01 16:41:47.093673 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-def111d0-bc27-454c-a681-999a40d485a2 req-f46a86be-9170-44c5-866b-433b30436d89 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042227 Sep 01 16:41:47.094694 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 488/941] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:47.251446 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6b56bd61-d3b7-40bd-aba6-684e167ba044 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:47.251980 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-6b56bd61-d3b7-40bd-aba6-684e167ba044 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:47.254283 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:47.261369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6b56bd61-d3b7-40bd-aba6-684e167ba044 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:47.261851 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6b56bd61-d3b7-40bd-aba6-684e167ba044 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:47.262300 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6b56bd61-d3b7-40bd-aba6-684e167ba044 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:47.263022 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6b56bd61-d3b7-40bd-aba6-684e167ba044 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:47.263519 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6b56bd61-d3b7-40bd-aba6-684e167ba044 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:47.263936 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6b56bd61-d3b7-40bd-aba6-684e167ba044 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:47.487509 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-6b56bd61-d3b7-40bd-aba6-684e167ba044 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:47.495835 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-6b56bd61-d3b7-40bd-aba6-684e167ba044 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff" status: 200 len: 1368 microversion: 2.1 time: 0.248376 Sep 01 16:41:47.496437 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 454/942] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:47 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:48.517942 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6e73ac0b-7286-4324-b455-c1517c2091a3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:48.519676 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6e73ac0b-7286-4324-b455-c1517c2091a3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:48.527698 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e73ac0b-7286-4324-b455-c1517c2091a3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:48.528185 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e73ac0b-7286-4324-b455-c1517c2091a3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:48.528749 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e73ac0b-7286-4324-b455-c1517c2091a3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:48.529452 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e73ac0b-7286-4324-b455-c1517c2091a3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:48.529906 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e73ac0b-7286-4324-b455-c1517c2091a3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:48.530348 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e73ac0b-7286-4324-b455-c1517c2091a3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:48.694845 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6e73ac0b-7286-4324-b455-c1517c2091a3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:48.704025 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6e73ac0b-7286-4324-b455-c1517c2091a3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff" status: 200 len: 1368 microversion: 2.1 time: 0.190712 Sep 01 16:41:48.704782 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 489/943] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:48 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:49.725449 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-76fc4033-7a97-4da7-bbdc-aa60e7916011 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:49.727870 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-76fc4033-7a97-4da7-bbdc-aa60e7916011 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:49.733943 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-76fc4033-7a97-4da7-bbdc-aa60e7916011 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:49.734683 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-76fc4033-7a97-4da7-bbdc-aa60e7916011 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:49.735125 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-76fc4033-7a97-4da7-bbdc-aa60e7916011 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:49.735838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-76fc4033-7a97-4da7-bbdc-aa60e7916011 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:49.736293 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-76fc4033-7a97-4da7-bbdc-aa60e7916011 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:49.736719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-76fc4033-7a97-4da7-bbdc-aa60e7916011 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:49.879742 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-76fc4033-7a97-4da7-bbdc-aa60e7916011 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:49.887520 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-76fc4033-7a97-4da7-bbdc-aa60e7916011 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff" status: 200 len: 1368 microversion: 2.1 time: 0.165874 Sep 01 16:41:49.888098 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 455/944] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:49 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:50.908821 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-45f3a6fc-3e61-4551-a1ee-c198bbbf5923 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:50.909610 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-45f3a6fc-3e61-4551-a1ee-c198bbbf5923 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:50.917108 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45f3a6fc-3e61-4551-a1ee-c198bbbf5923 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:50.917575 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45f3a6fc-3e61-4551-a1ee-c198bbbf5923 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:50.918052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45f3a6fc-3e61-4551-a1ee-c198bbbf5923 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:50.918879 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45f3a6fc-3e61-4551-a1ee-c198bbbf5923 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:50.919552 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45f3a6fc-3e61-4551-a1ee-c198bbbf5923 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:50.920052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-45f3a6fc-3e61-4551-a1ee-c198bbbf5923 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:51.066912 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-45f3a6fc-3e61-4551-a1ee-c198bbbf5923 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:51.075623 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-45f3a6fc-3e61-4551-a1ee-c198bbbf5923 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff" status: 200 len: 1368 microversion: 2.1 time: 0.170505 Sep 01 16:41:51.076376 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 490/945] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:50 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:51.238058 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-1c61e0bd-c0da-4dfd-ac46-f0a5bf85eb0d req-ecf224c3-fabf-46b4-857f-9002a5a6907b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "870a289a-9e2c-4471-ac02-f9aa77461aff", "name": "network-vif-plugged", "status": "completed", "tag": "75ac0e1d-9e18-472b-a40c-6d01c150b883"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:51.249310 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-1c61e0bd-c0da-4dfd-ac46-f0a5bf85eb0d req-ecf224c3-fabf-46b4-857f-9002a5a6907b service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:51.249778 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-1c61e0bd-c0da-4dfd-ac46-f0a5bf85eb0d req-ecf224c3-fabf-46b4-857f-9002a5a6907b service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:51.250194 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-1c61e0bd-c0da-4dfd-ac46-f0a5bf85eb0d req-ecf224c3-fabf-46b4-857f-9002a5a6907b service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:51.261878 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-1c61e0bd-c0da-4dfd-ac46-f0a5bf85eb0d req-ecf224c3-fabf-46b4-857f-9002a5a6907b service nova] Creating event network-vif-plugged:75ac0e1d-9e18-472b-a40c-6d01c150b883 for instance 870a289a-9e2c-4471-ac02-f9aa77461aff on hv-cinder-85220 Sep 01 16:41:51.266915 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-1c61e0bd-c0da-4dfd-ac46-f0a5bf85eb0d req-ecf224c3-fabf-46b4-857f-9002a5a6907b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032866 Sep 01 16:41:51.267508 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 456/946] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:52.097491 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e483bbb6-5cb7-4a63-a09a-50dd733245c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:52.098092 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e483bbb6-5cb7-4a63-a09a-50dd733245c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:52.100512 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:52.106069 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e483bbb6-5cb7-4a63-a09a-50dd733245c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:52.106586 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e483bbb6-5cb7-4a63-a09a-50dd733245c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:52.107022 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e483bbb6-5cb7-4a63-a09a-50dd733245c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:52.107712 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e483bbb6-5cb7-4a63-a09a-50dd733245c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:52.108155 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e483bbb6-5cb7-4a63-a09a-50dd733245c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:52.108570 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e483bbb6-5cb7-4a63-a09a-50dd733245c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:52.240944 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e483bbb6-5cb7-4a63-a09a-50dd733245c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:52.249034 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e483bbb6-5cb7-4a63-a09a-50dd733245c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff" status: 200 len: 1368 microversion: 2.1 time: 0.155897 Sep 01 16:41:52.249614 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 491/947] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:52 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:53.271160 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6ccc59f5-20e6-4527-af67-93005a0fe33b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:53.271861 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-6ccc59f5-20e6-4527-af67-93005a0fe33b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:53.278166 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6ccc59f5-20e6-4527-af67-93005a0fe33b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:53.278677 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6ccc59f5-20e6-4527-af67-93005a0fe33b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:53.279116 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6ccc59f5-20e6-4527-af67-93005a0fe33b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:53.279803 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6ccc59f5-20e6-4527-af67-93005a0fe33b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:53.280254 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6ccc59f5-20e6-4527-af67-93005a0fe33b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:53.280700 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6ccc59f5-20e6-4527-af67-93005a0fe33b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:53.412828 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-6ccc59f5-20e6-4527-af67-93005a0fe33b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:53.421018 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-6ccc59f5-20e6-4527-af67-93005a0fe33b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff" status: 200 len: 1558 microversion: 2.1 time: 0.154937 Sep 01 16:41:53.421586 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 457/948] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:53 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:53.441959 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ed73a9fc-e89a-4f9a-b202-5de2e0b38c23 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:53.442562 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ed73a9fc-e89a-4f9a-b202-5de2e0b38c23 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:53.449016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed73a9fc-e89a-4f9a-b202-5de2e0b38c23 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:53.449389 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed73a9fc-e89a-4f9a-b202-5de2e0b38c23 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:53.450054 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed73a9fc-e89a-4f9a-b202-5de2e0b38c23 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:53.450775 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed73a9fc-e89a-4f9a-b202-5de2e0b38c23 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:53.451221 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed73a9fc-e89a-4f9a-b202-5de2e0b38c23 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:53.451637 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed73a9fc-e89a-4f9a-b202-5de2e0b38c23 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:53.529955 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ed73a9fc-e89a-4f9a-b202-5de2e0b38c23 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091839 Sep 01 16:41:53.530752 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 492/949] 10.222.0.18 () {58 vars in 1275 bytes} [Thu Sep 1 16:41:53 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:54.515335 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-cdaea28f-cd65-414b-97c6-0974b5cfbdfb req-5043812f-5f4f-4c4b-a22e-e4014f3ae5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "870a289a-9e2c-4471-ac02-f9aa77461aff", "tag": "75ac0e1d-9e18-472b-a40c-6d01c150b883"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:54.521057 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=6 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:54.527231 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-cdaea28f-cd65-414b-97c6-0974b5cfbdfb req-5043812f-5f4f-4c4b-a22e-e4014f3ae5f8 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:54.528210 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-cdaea28f-cd65-414b-97c6-0974b5cfbdfb req-5043812f-5f4f-4c4b-a22e-e4014f3ae5f8 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:54.528642 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-cdaea28f-cd65-414b-97c6-0974b5cfbdfb req-5043812f-5f4f-4c4b-a22e-e4014f3ae5f8 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:54.539678 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-cdaea28f-cd65-414b-97c6-0974b5cfbdfb req-5043812f-5f4f-4c4b-a22e-e4014f3ae5f8 service nova] Creating event network-changed:75ac0e1d-9e18-472b-a40c-6d01c150b883 for instance 870a289a-9e2c-4471-ac02-f9aa77461aff on hv-cinder-85220 Sep 01 16:41:54.544607 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-cdaea28f-cd65-414b-97c6-0974b5cfbdfb req-5043812f-5f4f-4c4b-a22e-e4014f3ae5f8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032948 Sep 01 16:41:54.545538 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 458/950] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:58.340847 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:58.341638 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=6 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:58.346553 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4853dc8b-4de9-4ed2-a32f-a9f3663513b6 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:58.348793 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4853dc8b-4de9-4ed2-a32f-a9f3663513b6 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:58.356636 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4853dc8b-4de9-4ed2-a32f-a9f3663513b6 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:58.357120 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4853dc8b-4de9-4ed2-a32f-a9f3663513b6 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:58.357551 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4853dc8b-4de9-4ed2-a32f-a9f3663513b6 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:58.358266 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4853dc8b-4de9-4ed2-a32f-a9f3663513b6 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:58.358719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4853dc8b-4de9-4ed2-a32f-a9f3663513b6 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:58.359139 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4853dc8b-4de9-4ed2-a32f-a9f3663513b6 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:58.430954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4853dc8b-4de9-4ed2-a32f-a9f3663513b6 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "POST /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/action" status: 202 len: 0 microversion: 2.1 time: 0.090556 Sep 01 16:41:58.434638 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 493/951] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 1 16:41:58 2022] POST /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:41:58.440896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-305738ff-5431-4100-89ca-58f2f2f956ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:58.441589 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-305738ff-5431-4100-89ca-58f2f2f956ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:58.448700 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-305738ff-5431-4100-89ca-58f2f2f956ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:58.449322 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-305738ff-5431-4100-89ca-58f2f2f956ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:58.449763 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-305738ff-5431-4100-89ca-58f2f2f956ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:58.450550 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-305738ff-5431-4100-89ca-58f2f2f956ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:58.451052 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-305738ff-5431-4100-89ca-58f2f2f956ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:58.451481 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-305738ff-5431-4100-89ca-58f2f2f956ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:58.712166 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-305738ff-5431-4100-89ca-58f2f2f956ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:58.720715 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-305738ff-5431-4100-89ca-58f2f2f956ba tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1751 microversion: 2.1 time: 0.284559 Sep 01 16:41:58.721297 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 459/952] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:58 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1751 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:59.743504 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a380d564-dede-4229-b8b0-ec353aae8220 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:59.744291 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a380d564-dede-4229-b8b0-ec353aae8220 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:59.759800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a380d564-dede-4229-b8b0-ec353aae8220 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:59.760551 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a380d564-dede-4229-b8b0-ec353aae8220 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:59.760983 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a380d564-dede-4229-b8b0-ec353aae8220 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:59.761763 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a380d564-dede-4229-b8b0-ec353aae8220 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:59.762226 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a380d564-dede-4229-b8b0-ec353aae8220 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:59.762670 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a380d564-dede-4229-b8b0-ec353aae8220 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:59.909830 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a380d564-dede-4229-b8b0-ec353aae8220 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:59.918030 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a380d564-dede-4229-b8b0-ec353aae8220 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1756 microversion: 2.1 time: 0.179713 Sep 01 16:41:59.918632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 494/953] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:59 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:00.940304 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b7841b96-878c-4c80-a76b-8168495f9f0d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:00.940853 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b7841b96-878c-4c80-a76b-8168495f9f0d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:00.947959 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7841b96-878c-4c80-a76b-8168495f9f0d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:00.948449 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7841b96-878c-4c80-a76b-8168495f9f0d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:00.948886 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7841b96-878c-4c80-a76b-8168495f9f0d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:00.949589 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7841b96-878c-4c80-a76b-8168495f9f0d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:00.950033 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7841b96-878c-4c80-a76b-8168495f9f0d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:00.950491 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7841b96-878c-4c80-a76b-8168495f9f0d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:01.099768 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b7841b96-878c-4c80-a76b-8168495f9f0d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:01.109027 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b7841b96-878c-4c80-a76b-8168495f9f0d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1756 microversion: 2.1 time: 0.172785 Sep 01 16:42:01.109608 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 460/954] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:00 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:02.130348 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-53fe62be-8f48-4021-8e8e-616b6580d6f8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:02.130956 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-53fe62be-8f48-4021-8e8e-616b6580d6f8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:02.137919 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-53fe62be-8f48-4021-8e8e-616b6580d6f8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:02.138436 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-53fe62be-8f48-4021-8e8e-616b6580d6f8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:02.138865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-53fe62be-8f48-4021-8e8e-616b6580d6f8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:02.139550 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-53fe62be-8f48-4021-8e8e-616b6580d6f8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:02.139997 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-53fe62be-8f48-4021-8e8e-616b6580d6f8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:02.140413 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-53fe62be-8f48-4021-8e8e-616b6580d6f8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:02.293411 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-53fe62be-8f48-4021-8e8e-616b6580d6f8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:02.301908 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-53fe62be-8f48-4021-8e8e-616b6580d6f8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1756 microversion: 2.1 time: 0.175474 Sep 01 16:42:02.302523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 495/955] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:02 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:03.323788 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-973bc20e-c228-4bbd-9f04-5d94cdc8aa54 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:03.324388 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-973bc20e-c228-4bbd-9f04-5d94cdc8aa54 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:03.330817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-973bc20e-c228-4bbd-9f04-5d94cdc8aa54 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:03.331287 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-973bc20e-c228-4bbd-9f04-5d94cdc8aa54 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:03.331712 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-973bc20e-c228-4bbd-9f04-5d94cdc8aa54 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:03.332383 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-973bc20e-c228-4bbd-9f04-5d94cdc8aa54 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:03.332822 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-973bc20e-c228-4bbd-9f04-5d94cdc8aa54 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:03.333232 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-973bc20e-c228-4bbd-9f04-5d94cdc8aa54 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:03.478782 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-973bc20e-c228-4bbd-9f04-5d94cdc8aa54 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:03.487208 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-973bc20e-c228-4bbd-9f04-5d94cdc8aa54 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1756 microversion: 2.1 time: 0.167264 Sep 01 16:42:03.487811 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 461/956] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:03 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:42:04.507181 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-df26ab20-ad49-49f5-bbea-560034b76bbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:04.507750 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-df26ab20-ad49-49f5-bbea-560034b76bbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:04.514110 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df26ab20-ad49-49f5-bbea-560034b76bbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:04.514618 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df26ab20-ad49-49f5-bbea-560034b76bbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:04.515045 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df26ab20-ad49-49f5-bbea-560034b76bbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:04.515720 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df26ab20-ad49-49f5-bbea-560034b76bbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:04.516167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df26ab20-ad49-49f5-bbea-560034b76bbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:04.516585 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df26ab20-ad49-49f5-bbea-560034b76bbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:04.659013 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-df26ab20-ad49-49f5-bbea-560034b76bbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:04.667727 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-df26ab20-ad49-49f5-bbea-560034b76bbd tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1756 microversion: 2.1 time: 0.164431 Sep 01 16:42:04.668292 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 496/957] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:04 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:05.689499 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-91ac590c-32ca-4d9e-8525-9c0047196e0f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:05.690093 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-91ac590c-32ca-4d9e-8525-9c0047196e0f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:05.697311 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-91ac590c-32ca-4d9e-8525-9c0047196e0f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:05.697790 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-91ac590c-32ca-4d9e-8525-9c0047196e0f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:05.698219 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-91ac590c-32ca-4d9e-8525-9c0047196e0f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:05.698931 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-91ac590c-32ca-4d9e-8525-9c0047196e0f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:05.699387 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-91ac590c-32ca-4d9e-8525-9c0047196e0f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:05.699803 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-91ac590c-32ca-4d9e-8525-9c0047196e0f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:05.871196 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-91ac590c-32ca-4d9e-8525-9c0047196e0f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:05.879423 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-91ac590c-32ca-4d9e-8525-9c0047196e0f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1756 microversion: 2.1 time: 0.193996 Sep 01 16:42:05.879992 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 462/958] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:05 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:06.900694 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8ce5ed76-3cb9-4107-b7a7-3374e090c9a5 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:06.901294 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8ce5ed76-3cb9-4107-b7a7-3374e090c9a5 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:06.907830 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8ce5ed76-3cb9-4107-b7a7-3374e090c9a5 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:06.908396 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8ce5ed76-3cb9-4107-b7a7-3374e090c9a5 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:06.908846 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8ce5ed76-3cb9-4107-b7a7-3374e090c9a5 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:06.909530 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8ce5ed76-3cb9-4107-b7a7-3374e090c9a5 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:06.910002 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8ce5ed76-3cb9-4107-b7a7-3374e090c9a5 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:06.910448 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8ce5ed76-3cb9-4107-b7a7-3374e090c9a5 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:07.053910 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8ce5ed76-3cb9-4107-b7a7-3374e090c9a5 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:07.062054 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8ce5ed76-3cb9-4107-b7a7-3374e090c9a5 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1756 microversion: 2.1 time: 0.165210 Sep 01 16:42:07.062641 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 497/959] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:06 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:08.083037 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c68c2d2a-8237-489d-94a3-3ab15560649e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:08.083620 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c68c2d2a-8237-489d-94a3-3ab15560649e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:08.089527 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c68c2d2a-8237-489d-94a3-3ab15560649e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:08.090030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c68c2d2a-8237-489d-94a3-3ab15560649e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:08.090487 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c68c2d2a-8237-489d-94a3-3ab15560649e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:08.091171 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c68c2d2a-8237-489d-94a3-3ab15560649e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:08.091614 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c68c2d2a-8237-489d-94a3-3ab15560649e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:08.092048 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c68c2d2a-8237-489d-94a3-3ab15560649e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:08.246598 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c68c2d2a-8237-489d-94a3-3ab15560649e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:08.255390 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c68c2d2a-8237-489d-94a3-3ab15560649e tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1756 microversion: 2.1 time: 0.176331 Sep 01 16:42:08.255968 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 463/960] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:08 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:09.104296 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2006225099", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-346534431", "security_groups": [{"name": "tempest-secgroup-smoke-1444885176"}], "block_device_mapping_v2": [{"uuid": "3f599f01-54b9-4cdb-8ffa-547700822608", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5fae8c7f-11cf-4ab3-8c34-e624963abdb8"}]}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:09.218006 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] validate_networks() for [('5fae8c7f-11cf-4ab3-8c34-e624963abdb8', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:42:09.277765 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a843d4d1-8edb-4218-aa1e-a9820a34218c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:09.278781 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a843d4d1-8edb-4218-aa1e-a9820a34218c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:09.285301 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a843d4d1-8edb-4218-aa1e-a9820a34218c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:09.286021 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a843d4d1-8edb-4218-aa1e-a9820a34218c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:09.286557 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a843d4d1-8edb-4218-aa1e-a9820a34218c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:09.287545 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a843d4d1-8edb-4218-aa1e-a9820a34218c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:09.288211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a843d4d1-8edb-4218-aa1e-a9820a34218c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:09.289250 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a843d4d1-8edb-4218-aa1e-a9820a34218c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:09.519327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a843d4d1-8edb-4218-aa1e-a9820a34218c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:09.528337 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a843d4d1-8edb-4218-aa1e-a9820a34218c tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1756 microversion: 2.1 time: 0.255239 Sep 01 16:42:09.529101 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 464/961] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:09 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1756 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:42:09.604777 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:42:09.605224 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:42:09.605695 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:42:09.606166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:42:09.606635 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:42:09.616418 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:09.616906 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:09.617331 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:09.618072 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:09.618558 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:09.618973 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:09.636058 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Getting quotas for project 4b6bf55e6c5e47f3895e135c4d6dc3ff. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:42:09.640146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Getting quotas for user a3059f5115bb4bad837daf9f18752143 and project 4b6bf55e6c5e47f3895e135c4d6dc3ff. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:42:09.696750 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:42:09.698964 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f599f01-54b9-4cdb-8ffa-547700822608',volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:42:09.825118 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3e3e9f5a-8f2c-4694-a21c-840af3f79703 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.725591 Sep 01 16:42:09.825929 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 498/962] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:42:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:42:09.837946 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d0f0464c-af69-4e9f-8e3c-03f567e54afd tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:09.838620 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d0f0464c-af69-4e9f-8e3c-03f567e54afd tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:09.892917 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d0f0464c-af69-4e9f-8e3c-03f567e54afd tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:09.900337 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d0f0464c-af69-4e9f-8e3c-03f567e54afd tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1094 microversion: 2.1 time: 0.067276 Sep 01 16:42:09.900914 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 465/963] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:09 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:42:10.549288 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2c016a12-7969-4e10-91a3-d29016115f6d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:10.549988 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2c016a12-7969-4e10-91a3-d29016115f6d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:10.557208 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c016a12-7969-4e10-91a3-d29016115f6d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:10.557691 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c016a12-7969-4e10-91a3-d29016115f6d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:10.558128 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c016a12-7969-4e10-91a3-d29016115f6d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:10.558848 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c016a12-7969-4e10-91a3-d29016115f6d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:10.559304 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c016a12-7969-4e10-91a3-d29016115f6d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:10.559728 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c016a12-7969-4e10-91a3-d29016115f6d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:10.706517 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2c016a12-7969-4e10-91a3-d29016115f6d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:10.715164 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2c016a12-7969-4e10-91a3-d29016115f6d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1756 microversion: 2.1 time: 0.170161 Sep 01 16:42:10.715723 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 499/964] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:10 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:10.920604 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ec12eb8d-7a4b-48f3-babf-6854a8984126 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:10.921212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ec12eb8d-7a4b-48f3-babf-6854a8984126 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:10.928410 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ec12eb8d-7a4b-48f3-babf-6854a8984126 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:10.928885 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ec12eb8d-7a4b-48f3-babf-6854a8984126 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:10.929310 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ec12eb8d-7a4b-48f3-babf-6854a8984126 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:10.929987 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ec12eb8d-7a4b-48f3-babf-6854a8984126 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:10.930460 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ec12eb8d-7a4b-48f3-babf-6854a8984126 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:10.930875 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ec12eb8d-7a4b-48f3-babf-6854a8984126 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:10.991919 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ec12eb8d-7a4b-48f3-babf-6854a8984126 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:11.000140 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ec12eb8d-7a4b-48f3-babf-6854a8984126 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1192 microversion: 2.1 time: 0.083321 Sep 01 16:42:11.000714 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 466/965] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:10 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:11.737265 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5ca47079-5ad7-4c41-9032-ffff73f24d08 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:11.738063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5ca47079-5ad7-4c41-9032-ffff73f24d08 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:11.745445 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ca47079-5ad7-4c41-9032-ffff73f24d08 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:11.745928 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ca47079-5ad7-4c41-9032-ffff73f24d08 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:11.746384 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ca47079-5ad7-4c41-9032-ffff73f24d08 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:11.747396 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ca47079-5ad7-4c41-9032-ffff73f24d08 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:11.748019 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ca47079-5ad7-4c41-9032-ffff73f24d08 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:11.748513 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ca47079-5ad7-4c41-9032-ffff73f24d08 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:11.900303 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5ca47079-5ad7-4c41-9032-ffff73f24d08 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:11.908733 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5ca47079-5ad7-4c41-9032-ffff73f24d08 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1756 microversion: 2.1 time: 0.175378 Sep 01 16:42:11.909320 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 500/966] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:11 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:12.020810 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-17986616-368d-4677-88b5-4f4582c63df6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:12.021626 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-17986616-368d-4677-88b5-4f4582c63df6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:12.028160 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17986616-368d-4677-88b5-4f4582c63df6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.028723 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17986616-368d-4677-88b5-4f4582c63df6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.029164 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17986616-368d-4677-88b5-4f4582c63df6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:12.029854 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17986616-368d-4677-88b5-4f4582c63df6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.030376 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17986616-368d-4677-88b5-4f4582c63df6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.030803 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-17986616-368d-4677-88b5-4f4582c63df6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:12.289386 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-17986616-368d-4677-88b5-4f4582c63df6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:12.297158 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-17986616-368d-4677-88b5-4f4582c63df6 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1278 microversion: 2.1 time: 0.280386 Sep 01 16:42:12.297739 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 467/967] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:12 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1278 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:12.824683 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-321e7218-4b84-45e9-845f-84f46d060e78 req-d62eb38a-943f-4de4-8d52-a3c16facfb2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05425634-c94f-4f95-a99b-ee2058fd092d", "tag": "246797ab-f380-41b3-b1f0-53ace837a15f"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:12.837740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-321e7218-4b84-45e9-845f-84f46d060e78 req-d62eb38a-943f-4de4-8d52-a3c16facfb2d service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.838501 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-321e7218-4b84-45e9-845f-84f46d060e78 req-d62eb38a-943f-4de4-8d52-a3c16facfb2d service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.838843 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-321e7218-4b84-45e9-845f-84f46d060e78 req-d62eb38a-943f-4de4-8d52-a3c16facfb2d service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:12.851343 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-321e7218-4b84-45e9-845f-84f46d060e78 req-d62eb38a-943f-4de4-8d52-a3c16facfb2d service nova] Creating event network-changed:246797ab-f380-41b3-b1f0-53ace837a15f for instance 05425634-c94f-4f95-a99b-ee2058fd092d on hv-cinder-85220 Sep 01 16:42:12.856258 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-321e7218-4b84-45e9-845f-84f46d060e78 req-d62eb38a-943f-4de4-8d52-a3c16facfb2d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037280 Sep 01 16:42:12.857237 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 501/968] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:12.930592 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c43f581b-83d5-4fef-af37-645583b0b07a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:12.931208 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c43f581b-83d5-4fef-af37-645583b0b07a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:12.937143 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c43f581b-83d5-4fef-af37-645583b0b07a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.937622 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c43f581b-83d5-4fef-af37-645583b0b07a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.938053 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c43f581b-83d5-4fef-af37-645583b0b07a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:12.938774 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c43f581b-83d5-4fef-af37-645583b0b07a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.939226 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c43f581b-83d5-4fef-af37-645583b0b07a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.939681 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c43f581b-83d5-4fef-af37-645583b0b07a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:13.082876 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c43f581b-83d5-4fef-af37-645583b0b07a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:13.091089 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c43f581b-83d5-4fef-af37-645583b0b07a tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1756 microversion: 2.1 time: 0.164450 Sep 01 16:42:13.091653 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 468/969] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:12 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:13.318577 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ff0625a8-2ab4-408d-ba6d-94d5d5174acf tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:13.319266 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ff0625a8-2ab4-408d-ba6d-94d5d5174acf tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:13.327074 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff0625a8-2ab4-408d-ba6d-94d5d5174acf tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:13.327548 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff0625a8-2ab4-408d-ba6d-94d5d5174acf tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:13.327973 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff0625a8-2ab4-408d-ba6d-94d5d5174acf tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:13.328652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff0625a8-2ab4-408d-ba6d-94d5d5174acf tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:13.329094 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff0625a8-2ab4-408d-ba6d-94d5d5174acf tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:13.329507 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff0625a8-2ab4-408d-ba6d-94d5d5174acf tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:13.470181 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ff0625a8-2ab4-408d-ba6d-94d5d5174acf tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:13.479006 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ff0625a8-2ab4-408d-ba6d-94d5d5174acf tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1266 microversion: 2.1 time: 0.164540 Sep 01 16:42:13.479682 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 502/970] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:13 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:14.112218 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-4b563853-60cf-41e9-bd5e-224d49c68687 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:14.112872 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-4b563853-60cf-41e9-bd5e-224d49c68687 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:14.119773 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4b563853-60cf-41e9-bd5e-224d49c68687 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:14.120249 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4b563853-60cf-41e9-bd5e-224d49c68687 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:14.120677 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4b563853-60cf-41e9-bd5e-224d49c68687 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:14.121357 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4b563853-60cf-41e9-bd5e-224d49c68687 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:14.121801 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4b563853-60cf-41e9-bd5e-224d49c68687 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:14.122220 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4b563853-60cf-41e9-bd5e-224d49c68687 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:14.306212 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-4b563853-60cf-41e9-bd5e-224d49c68687 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:14.314484 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-4b563853-60cf-41e9-bd5e-224d49c68687 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1756 microversion: 2.1 time: 0.206119 Sep 01 16:42:14.315067 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 469/971] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:14 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1756 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:14.500894 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-01e695f1-85f2-4574-acc3-c800b814075d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:14.501583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-01e695f1-85f2-4574-acc3-c800b814075d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:14.508046 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01e695f1-85f2-4574-acc3-c800b814075d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:14.508523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01e695f1-85f2-4574-acc3-c800b814075d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:14.508948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01e695f1-85f2-4574-acc3-c800b814075d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:14.509638 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01e695f1-85f2-4574-acc3-c800b814075d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:14.510083 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01e695f1-85f2-4574-acc3-c800b814075d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:14.510530 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01e695f1-85f2-4574-acc3-c800b814075d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:14.651889 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-01e695f1-85f2-4574-acc3-c800b814075d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:14.659675 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-01e695f1-85f2-4574-acc3-c800b814075d tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1266 microversion: 2.1 time: 0.162591 Sep 01 16:42:14.660449 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 503/972] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:14 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:15.335413 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-6919af12-1e9a-4756-a81c-3b293c089cbf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:15.336018 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-6919af12-1e9a-4756-a81c-3b293c089cbf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:15.342364 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6919af12-1e9a-4756-a81c-3b293c089cbf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:15.342838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6919af12-1e9a-4756-a81c-3b293c089cbf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:15.343266 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6919af12-1e9a-4756-a81c-3b293c089cbf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:15.343941 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6919af12-1e9a-4756-a81c-3b293c089cbf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:15.344382 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6919af12-1e9a-4756-a81c-3b293c089cbf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:15.344801 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-6919af12-1e9a-4756-a81c-3b293c089cbf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:15.487374 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-6919af12-1e9a-4756-a81c-3b293c089cbf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:15.496507 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-6919af12-1e9a-4756-a81c-3b293c089cbf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1756 microversion: 2.1 time: 0.164841 Sep 01 16:42:15.497095 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 470/973] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:15 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:15.681222 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7b6573ad-876d-498b-98d3-cfc8cb8bc690 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:15.681778 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7b6573ad-876d-498b-98d3-cfc8cb8bc690 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:15.688148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7b6573ad-876d-498b-98d3-cfc8cb8bc690 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:15.688612 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7b6573ad-876d-498b-98d3-cfc8cb8bc690 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:15.689046 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7b6573ad-876d-498b-98d3-cfc8cb8bc690 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:15.689729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7b6573ad-876d-498b-98d3-cfc8cb8bc690 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:15.690182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7b6573ad-876d-498b-98d3-cfc8cb8bc690 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:15.690633 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7b6573ad-876d-498b-98d3-cfc8cb8bc690 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:15.830107 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7b6573ad-876d-498b-98d3-cfc8cb8bc690 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:15.837874 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7b6573ad-876d-498b-98d3-cfc8cb8bc690 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1266 microversion: 2.1 time: 0.161271 Sep 01 16:42:15.838466 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 504/974] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:15 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:16.517664 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-839f80d7-9778-4dab-9610-2f45ab6f1115 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:16.518292 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-839f80d7-9778-4dab-9610-2f45ab6f1115 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:16.525385 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-839f80d7-9778-4dab-9610-2f45ab6f1115 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:16.525862 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-839f80d7-9778-4dab-9610-2f45ab6f1115 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:16.526327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-839f80d7-9778-4dab-9610-2f45ab6f1115 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:16.527016 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-839f80d7-9778-4dab-9610-2f45ab6f1115 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:16.527460 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-839f80d7-9778-4dab-9610-2f45ab6f1115 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:16.527896 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-839f80d7-9778-4dab-9610-2f45ab6f1115 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:16.531917 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=95 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:16.669666 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-839f80d7-9778-4dab-9610-2f45ab6f1115 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:16.677827 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-839f80d7-9778-4dab-9610-2f45ab6f1115 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1759 microversion: 2.1 time: 0.164030 Sep 01 16:42:16.678429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 471/975] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:16 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:16.859935 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ed6b63d3-fd38-42fd-b91f-27f6c2e37957 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:16.860536 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ed6b63d3-fd38-42fd-b91f-27f6c2e37957 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:16.867117 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed6b63d3-fd38-42fd-b91f-27f6c2e37957 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:16.867755 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed6b63d3-fd38-42fd-b91f-27f6c2e37957 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:16.868181 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed6b63d3-fd38-42fd-b91f-27f6c2e37957 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:16.868861 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed6b63d3-fd38-42fd-b91f-27f6c2e37957 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:16.869301 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed6b63d3-fd38-42fd-b91f-27f6c2e37957 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:16.869827 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ed6b63d3-fd38-42fd-b91f-27f6c2e37957 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:16.997388 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ed6b63d3-fd38-42fd-b91f-27f6c2e37957 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:17.005195 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ed6b63d3-fd38-42fd-b91f-27f6c2e37957 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1266 microversion: 2.1 time: 0.149104 Sep 01 16:42:17.005756 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 505/976] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:16 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:18.026264 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-1ec7a1ec-a263-4a89-8554-1d62d724724b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:18.026860 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-1ec7a1ec-a263-4a89-8554-1d62d724724b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:18.029130 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=38 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:18.034332 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1ec7a1ec-a263-4a89-8554-1d62d724724b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:18.034808 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1ec7a1ec-a263-4a89-8554-1d62d724724b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:18.035242 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1ec7a1ec-a263-4a89-8554-1d62d724724b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:18.035917 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1ec7a1ec-a263-4a89-8554-1d62d724724b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:18.036364 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1ec7a1ec-a263-4a89-8554-1d62d724724b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:18.036780 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-1ec7a1ec-a263-4a89-8554-1d62d724724b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:18.165933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-1ec7a1ec-a263-4a89-8554-1d62d724724b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:18.173537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-1ec7a1ec-a263-4a89-8554-1d62d724724b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1266 microversion: 2.1 time: 0.151793 Sep 01 16:42:18.174123 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 472/977] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:18 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:19.194377 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-527d0b4d-e6f1-46c0-a92a-0f867fff57f1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:19.194914 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-527d0b4d-e6f1-46c0-a92a-0f867fff57f1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:19.201243 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-527d0b4d-e6f1-46c0-a92a-0f867fff57f1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:19.201719 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-527d0b4d-e6f1-46c0-a92a-0f867fff57f1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:19.202175 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-527d0b4d-e6f1-46c0-a92a-0f867fff57f1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:19.202882 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-527d0b4d-e6f1-46c0-a92a-0f867fff57f1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:19.203331 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-527d0b4d-e6f1-46c0-a92a-0f867fff57f1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:19.203741 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-527d0b4d-e6f1-46c0-a92a-0f867fff57f1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:19.206449 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:19.337210 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-527d0b4d-e6f1-46c0-a92a-0f867fff57f1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:19.344881 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-527d0b4d-e6f1-46c0-a92a-0f867fff57f1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1266 microversion: 2.1 time: 0.154384 Sep 01 16:42:19.345486 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 506/978] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:19 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:19.726719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-bae1e8bf-09b0-4d62-85d5-7ad734a0e3ef tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:19.727303 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-bae1e8bf-09b0-4d62-85d5-7ad734a0e3ef tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:19.733806 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bae1e8bf-09b0-4d62-85d5-7ad734a0e3ef tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:19.734318 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bae1e8bf-09b0-4d62-85d5-7ad734a0e3ef tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:19.734756 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bae1e8bf-09b0-4d62-85d5-7ad734a0e3ef tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:19.735434 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bae1e8bf-09b0-4d62-85d5-7ad734a0e3ef tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:19.735880 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bae1e8bf-09b0-4d62-85d5-7ad734a0e3ef tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:19.736295 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bae1e8bf-09b0-4d62-85d5-7ad734a0e3ef tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:19.759036 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.objects.instance [None req-bae1e8bf-09b0-4d62-85d5-7ad734a0e3ef tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lazy-loading 'flavor' on Instance uuid fad0df24-0b95-4583-9017-6322bebd55a0 {{(pid=127178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:42:19.865830 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-bae1e8bf-09b0-4d62-85d5-7ad734a0e3ef tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "POST /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0/action" status: 202 len: 0 microversion: 2.1 time: 0.143699 Sep 01 16:42:19.866583 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 473/979] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 1 16:42:19 2022] POST /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:42:19.874821 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1b9005b9-c0ad-4af0-92b4-8b0bd04784b2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:19.875416 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1b9005b9-c0ad-4af0-92b4-8b0bd04784b2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:19.877219 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:19.877853 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=6 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:19.884161 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1b9005b9-c0ad-4af0-92b4-8b0bd04784b2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:19.884635 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1b9005b9-c0ad-4af0-92b4-8b0bd04784b2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:19.885060 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1b9005b9-c0ad-4af0-92b4-8b0bd04784b2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:19.885733 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1b9005b9-c0ad-4af0-92b4-8b0bd04784b2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:19.886175 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1b9005b9-c0ad-4af0-92b4-8b0bd04784b2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:19.886615 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1b9005b9-c0ad-4af0-92b4-8b0bd04784b2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:20.016996 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1b9005b9-c0ad-4af0-92b4-8b0bd04784b2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:20.025252 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1b9005b9-c0ad-4af0-92b4-8b0bd04784b2 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1566 microversion: 2.1 time: 0.154190 Sep 01 16:42:20.025821 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 507/980] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:19 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:42:20.367417 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-850120cf-72a8-4050-a9c8-a105ac4dafea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:20.368110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-850120cf-72a8-4050-a9c8-a105ac4dafea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:20.370097 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:20.375695 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-850120cf-72a8-4050-a9c8-a105ac4dafea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:20.376175 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-850120cf-72a8-4050-a9c8-a105ac4dafea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:20.376603 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-850120cf-72a8-4050-a9c8-a105ac4dafea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:20.377290 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-850120cf-72a8-4050-a9c8-a105ac4dafea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:20.377739 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-850120cf-72a8-4050-a9c8-a105ac4dafea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:20.378159 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-850120cf-72a8-4050-a9c8-a105ac4dafea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:20.507593 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-850120cf-72a8-4050-a9c8-a105ac4dafea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:20.515613 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-850120cf-72a8-4050-a9c8-a105ac4dafea tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1266 microversion: 2.1 time: 0.152472 Sep 01 16:42:20.516185 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 474/981] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:20 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:21.048280 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9500d4fb-d49d-4897-892f-7ccbc3cabb8a tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:21.049143 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9500d4fb-d49d-4897-892f-7ccbc3cabb8a tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:21.056646 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9500d4fb-d49d-4897-892f-7ccbc3cabb8a tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:21.057200 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9500d4fb-d49d-4897-892f-7ccbc3cabb8a tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:21.057797 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9500d4fb-d49d-4897-892f-7ccbc3cabb8a tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:21.058524 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9500d4fb-d49d-4897-892f-7ccbc3cabb8a tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:21.059042 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9500d4fb-d49d-4897-892f-7ccbc3cabb8a tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:21.059606 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9500d4fb-d49d-4897-892f-7ccbc3cabb8a tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:21.193847 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9500d4fb-d49d-4897-892f-7ccbc3cabb8a tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:21.202103 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9500d4fb-d49d-4897-892f-7ccbc3cabb8a tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1566 microversion: 2.1 time: 0.158377 Sep 01 16:42:21.202700 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 508/982] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:21 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:21.536611 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-527c0963-05f1-47e2-869b-f76702a3b03f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:21.537204 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-527c0963-05f1-47e2-869b-f76702a3b03f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:21.544117 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-527c0963-05f1-47e2-869b-f76702a3b03f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:21.544592 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-527c0963-05f1-47e2-869b-f76702a3b03f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:21.545020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-527c0963-05f1-47e2-869b-f76702a3b03f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:21.545697 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-527c0963-05f1-47e2-869b-f76702a3b03f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:21.546142 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-527c0963-05f1-47e2-869b-f76702a3b03f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:21.546585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-527c0963-05f1-47e2-869b-f76702a3b03f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:21.683615 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-527c0963-05f1-47e2-869b-f76702a3b03f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:21.691281 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-527c0963-05f1-47e2-869b-f76702a3b03f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1266 microversion: 2.1 time: 0.158540 Sep 01 16:42:21.691847 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 475/983] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:21 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:22.224273 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6ad67c40-be23-4e8d-bb18-e057988fcca3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:22.225106 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6ad67c40-be23-4e8d-bb18-e057988fcca3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:22.227805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:22.233190 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6ad67c40-be23-4e8d-bb18-e057988fcca3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:22.233667 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6ad67c40-be23-4e8d-bb18-e057988fcca3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:22.234097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6ad67c40-be23-4e8d-bb18-e057988fcca3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:22.234917 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6ad67c40-be23-4e8d-bb18-e057988fcca3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:22.235367 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6ad67c40-be23-4e8d-bb18-e057988fcca3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:22.235789 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6ad67c40-be23-4e8d-bb18-e057988fcca3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:22.367369 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6ad67c40-be23-4e8d-bb18-e057988fcca3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:22.375386 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6ad67c40-be23-4e8d-bb18-e057988fcca3 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1566 microversion: 2.1 time: 0.155062 Sep 01 16:42:22.375967 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 509/984] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:22 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:22.713043 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-af06ef62-37b7-4a97-b3f2-e309969711aa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:22.713660 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-af06ef62-37b7-4a97-b3f2-e309969711aa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:22.720098 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-af06ef62-37b7-4a97-b3f2-e309969711aa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:22.720572 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-af06ef62-37b7-4a97-b3f2-e309969711aa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:22.721002 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-af06ef62-37b7-4a97-b3f2-e309969711aa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:22.721692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-af06ef62-37b7-4a97-b3f2-e309969711aa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:22.722167 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-af06ef62-37b7-4a97-b3f2-e309969711aa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:22.722616 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-af06ef62-37b7-4a97-b3f2-e309969711aa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:22.851367 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-af06ef62-37b7-4a97-b3f2-e309969711aa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:22.859055 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-af06ef62-37b7-4a97-b3f2-e309969711aa tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1266 microversion: 2.1 time: 0.150427 Sep 01 16:42:22.859610 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 476/985] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:22 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:23.396709 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0527ef00-2786-41bb-889a-6910b89f9be5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:23.397287 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-6bf112b7-ebc1-4094-b83e-0e03a073b685 req-7c033ec0-29ea-4fea-9806-20964fa43bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05425634-c94f-4f95-a99b-ee2058fd092d", "name": "network-vif-plugged", "status": "completed", "tag": "246797ab-f380-41b3-b1f0-53ace837a15f"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:23.397400 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0527ef00-2786-41bb-889a-6910b89f9be5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:23.404561 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0527ef00-2786-41bb-889a-6910b89f9be5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:23.405203 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0527ef00-2786-41bb-889a-6910b89f9be5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:23.405705 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0527ef00-2786-41bb-889a-6910b89f9be5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:23.406600 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0527ef00-2786-41bb-889a-6910b89f9be5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:23.407142 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0527ef00-2786-41bb-889a-6910b89f9be5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:23.407529 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0527ef00-2786-41bb-889a-6910b89f9be5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:23.407878 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-6bf112b7-ebc1-4094-b83e-0e03a073b685 req-7c033ec0-29ea-4fea-9806-20964fa43bb3 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:23.408431 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-6bf112b7-ebc1-4094-b83e-0e03a073b685 req-7c033ec0-29ea-4fea-9806-20964fa43bb3 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:23.408924 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-6bf112b7-ebc1-4094-b83e-0e03a073b685 req-7c033ec0-29ea-4fea-9806-20964fa43bb3 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:23.423412 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-6bf112b7-ebc1-4094-b83e-0e03a073b685 req-7c033ec0-29ea-4fea-9806-20964fa43bb3 service nova] Creating event network-vif-plugged:246797ab-f380-41b3-b1f0-53ace837a15f for instance 05425634-c94f-4f95-a99b-ee2058fd092d on hv-cinder-85220 Sep 01 16:42:23.428431 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-6bf112b7-ebc1-4094-b83e-0e03a073b685 req-7c033ec0-29ea-4fea-9806-20964fa43bb3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035259 Sep 01 16:42:23.429564 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 477/986] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:42:23.549378 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0527ef00-2786-41bb-889a-6910b89f9be5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:23.559610 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0527ef00-2786-41bb-889a-6910b89f9be5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1566 microversion: 2.1 time: 0.166598 Sep 01 16:42:23.560434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 510/987] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:23 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:23.880266 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d697bfc0-15ca-4165-a3f4-020c3a8fe023 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:23.880961 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d697bfc0-15ca-4165-a3f4-020c3a8fe023 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:23.887600 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d697bfc0-15ca-4165-a3f4-020c3a8fe023 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:23.888075 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d697bfc0-15ca-4165-a3f4-020c3a8fe023 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:23.888505 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d697bfc0-15ca-4165-a3f4-020c3a8fe023 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:23.889183 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d697bfc0-15ca-4165-a3f4-020c3a8fe023 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:23.889628 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d697bfc0-15ca-4165-a3f4-020c3a8fe023 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:23.890045 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d697bfc0-15ca-4165-a3f4-020c3a8fe023 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:24.175541 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d697bfc0-15ca-4165-a3f4-020c3a8fe023 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:24.183322 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d697bfc0-15ca-4165-a3f4-020c3a8fe023 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1266 microversion: 2.1 time: 0.307669 Sep 01 16:42:24.183888 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 478/988] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:23 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:24.580432 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c21032f2-a936-4b72-952a-b71d8f7727ae tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:24.581069 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c21032f2-a936-4b72-952a-b71d8f7727ae tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:24.588085 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c21032f2-a936-4b72-952a-b71d8f7727ae tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:24.588557 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c21032f2-a936-4b72-952a-b71d8f7727ae tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:24.588978 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c21032f2-a936-4b72-952a-b71d8f7727ae tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:24.589655 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c21032f2-a936-4b72-952a-b71d8f7727ae tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:24.590094 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c21032f2-a936-4b72-952a-b71d8f7727ae tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:24.590527 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c21032f2-a936-4b72-952a-b71d8f7727ae tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:24.725469 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c21032f2-a936-4b72-952a-b71d8f7727ae tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:24.733157 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c21032f2-a936-4b72-952a-b71d8f7727ae tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1566 microversion: 2.1 time: 0.156628 Sep 01 16:42:24.733715 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 511/989] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:24 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:25.204683 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b8ae6295-852d-44d4-835b-936e2c319d6c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:25.205229 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b8ae6295-852d-44d4-835b-936e2c319d6c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:25.212346 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b8ae6295-852d-44d4-835b-936e2c319d6c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:25.212826 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b8ae6295-852d-44d4-835b-936e2c319d6c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:25.213260 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b8ae6295-852d-44d4-835b-936e2c319d6c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:25.213949 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b8ae6295-852d-44d4-835b-936e2c319d6c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:25.214423 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b8ae6295-852d-44d4-835b-936e2c319d6c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:25.214845 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b8ae6295-852d-44d4-835b-936e2c319d6c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:25.343878 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b8ae6295-852d-44d4-835b-936e2c319d6c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:25.352088 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b8ae6295-852d-44d4-835b-936e2c319d6c tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1266 microversion: 2.1 time: 0.151307 Sep 01 16:42:25.352652 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 479/990] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:25 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:25.753204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ee0d30fa-8aed-441a-a51f-caa77b725fe5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:25.753808 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ee0d30fa-8aed-441a-a51f-caa77b725fe5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:25.760520 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee0d30fa-8aed-441a-a51f-caa77b725fe5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:25.761003 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee0d30fa-8aed-441a-a51f-caa77b725fe5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:25.761433 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee0d30fa-8aed-441a-a51f-caa77b725fe5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:25.762249 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee0d30fa-8aed-441a-a51f-caa77b725fe5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:25.762713 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee0d30fa-8aed-441a-a51f-caa77b725fe5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:25.763132 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee0d30fa-8aed-441a-a51f-caa77b725fe5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:25.893523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ee0d30fa-8aed-441a-a51f-caa77b725fe5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:25.901199 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ee0d30fa-8aed-441a-a51f-caa77b725fe5 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1566 microversion: 2.1 time: 0.151950 Sep 01 16:42:25.901762 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 512/991] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:25 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:26.372842 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-cd727e54-1e96-47e7-ac82-02ec1f629317 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:26.373425 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-cd727e54-1e96-47e7-ac82-02ec1f629317 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:26.384314 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cd727e54-1e96-47e7-ac82-02ec1f629317 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:26.385180 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cd727e54-1e96-47e7-ac82-02ec1f629317 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:26.385977 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cd727e54-1e96-47e7-ac82-02ec1f629317 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:26.387252 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cd727e54-1e96-47e7-ac82-02ec1f629317 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:26.388085 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cd727e54-1e96-47e7-ac82-02ec1f629317 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:26.388850 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-cd727e54-1e96-47e7-ac82-02ec1f629317 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:26.526318 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-cd727e54-1e96-47e7-ac82-02ec1f629317 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:26.534515 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-cd727e54-1e96-47e7-ac82-02ec1f629317 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1453 microversion: 2.1 time: 0.165551 Sep 01 16:42:26.535100 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 480/992] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:26 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:26.555826 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e558e601-97fe-4f58-84b9-a0fbc5cb0107 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:26.556437 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e558e601-97fe-4f58-84b9-a0fbc5cb0107 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:26.562392 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e558e601-97fe-4f58-84b9-a0fbc5cb0107 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:26.562895 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e558e601-97fe-4f58-84b9-a0fbc5cb0107 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:26.563315 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e558e601-97fe-4f58-84b9-a0fbc5cb0107 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:26.564007 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e558e601-97fe-4f58-84b9-a0fbc5cb0107 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:26.564465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e558e601-97fe-4f58-84b9-a0fbc5cb0107 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:26.564892 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e558e601-97fe-4f58-84b9-a0fbc5cb0107 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:26.698355 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e558e601-97fe-4f58-84b9-a0fbc5cb0107 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:26.706036 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e558e601-97fe-4f58-84b9-a0fbc5cb0107 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1453 microversion: 2.1 time: 0.154234 Sep 01 16:42:26.706642 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 513/993] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:26 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:26.921324 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b337d905-a360-4d9d-9601-c6f1f871c05b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:26.921846 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b337d905-a360-4d9d-9601-c6f1f871c05b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:26.927765 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b337d905-a360-4d9d-9601-c6f1f871c05b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:26.928857 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b337d905-a360-4d9d-9601-c6f1f871c05b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:26.929303 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b337d905-a360-4d9d-9601-c6f1f871c05b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:26.930010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b337d905-a360-4d9d-9601-c6f1f871c05b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:26.930491 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b337d905-a360-4d9d-9601-c6f1f871c05b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:26.930920 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b337d905-a360-4d9d-9601-c6f1f871c05b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:27.140229 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b337d905-a360-4d9d-9601-c6f1f871c05b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:27.148072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b337d905-a360-4d9d-9601-c6f1f871c05b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1566 microversion: 2.1 time: 0.230610 Sep 01 16:42:27.148646 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 481/994] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:26 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1566 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:28.168985 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dc217712-1b61-43a7-993d-982eadf11fee tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:28.169601 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-dc217712-1b61-43a7-993d-982eadf11fee tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:28.176311 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dc217712-1b61-43a7-993d-982eadf11fee tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:28.176802 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dc217712-1b61-43a7-993d-982eadf11fee tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:28.177255 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dc217712-1b61-43a7-993d-982eadf11fee tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:28.177958 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dc217712-1b61-43a7-993d-982eadf11fee tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:28.179108 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dc217712-1b61-43a7-993d-982eadf11fee tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:28.179532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dc217712-1b61-43a7-993d-982eadf11fee tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:28.314744 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dc217712-1b61-43a7-993d-982eadf11fee tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:28.323093 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-dc217712-1b61-43a7-993d-982eadf11fee tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1566 microversion: 2.1 time: 0.157894 Sep 01 16:42:28.323763 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 514/995] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:28 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:28.638754 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-3bee11b9-ae07-4469-889d-6a043771a191 req-d9cfb929-f352-48f2-b408-4d587ba309a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05425634-c94f-4f95-a99b-ee2058fd092d", "tag": "246797ab-f380-41b3-b1f0-53ace837a15f"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:28.649052 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-3bee11b9-ae07-4469-889d-6a043771a191 req-d9cfb929-f352-48f2-b408-4d587ba309a7 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:28.649579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-3bee11b9-ae07-4469-889d-6a043771a191 req-d9cfb929-f352-48f2-b408-4d587ba309a7 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:28.650045 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-3bee11b9-ae07-4469-889d-6a043771a191 req-d9cfb929-f352-48f2-b408-4d587ba309a7 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:28.661327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-3bee11b9-ae07-4469-889d-6a043771a191 req-d9cfb929-f352-48f2-b408-4d587ba309a7 service nova] Creating event network-changed:246797ab-f380-41b3-b1f0-53ace837a15f for instance 05425634-c94f-4f95-a99b-ee2058fd092d on hv-cinder-85220 Sep 01 16:42:28.668119 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-3bee11b9-ae07-4469-889d-6a043771a191 req-d9cfb929-f352-48f2-b408-4d587ba309a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032964 Sep 01 16:42:28.668780 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 482/996] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:29.344780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-250faf37-3226-4352-aba3-2a44ef470135 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:29.345548 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-250faf37-3226-4352-aba3-2a44ef470135 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:29.353099 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-250faf37-3226-4352-aba3-2a44ef470135 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:29.353696 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-250faf37-3226-4352-aba3-2a44ef470135 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:29.354470 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-250faf37-3226-4352-aba3-2a44ef470135 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:29.355123 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-250faf37-3226-4352-aba3-2a44ef470135 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:29.355805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-250faf37-3226-4352-aba3-2a44ef470135 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:29.356203 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-250faf37-3226-4352-aba3-2a44ef470135 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:29.499437 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-250faf37-3226-4352-aba3-2a44ef470135 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:29.508401 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-250faf37-3226-4352-aba3-2a44ef470135 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1566 microversion: 2.1 time: 0.167716 Sep 01 16:42:29.509051 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 515/997] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:29 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:30.530454 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-daea8a44-be2d-47ca-8a91-ad9dcb1eae3b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:30.531165 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-daea8a44-be2d-47ca-8a91-ad9dcb1eae3b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:30.537300 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-daea8a44-be2d-47ca-8a91-ad9dcb1eae3b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:30.537788 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-daea8a44-be2d-47ca-8a91-ad9dcb1eae3b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:30.538228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-daea8a44-be2d-47ca-8a91-ad9dcb1eae3b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:30.538977 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-daea8a44-be2d-47ca-8a91-ad9dcb1eae3b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:30.539426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-daea8a44-be2d-47ca-8a91-ad9dcb1eae3b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:30.539849 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-daea8a44-be2d-47ca-8a91-ad9dcb1eae3b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:30.758381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-daea8a44-be2d-47ca-8a91-ad9dcb1eae3b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:30.766536 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-daea8a44-be2d-47ca-8a91-ad9dcb1eae3b tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1566 microversion: 2.1 time: 0.240847 Sep 01 16:42:30.767249 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 483/998] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:30 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1566 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:31.788284 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-709f9c95-e0f5-4349-9a6e-c19f31f048d0 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:31.788884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-709f9c95-e0f5-4349-9a6e-c19f31f048d0 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:31.795477 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-709f9c95-e0f5-4349-9a6e-c19f31f048d0 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:31.795945 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-709f9c95-e0f5-4349-9a6e-c19f31f048d0 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:31.796370 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-709f9c95-e0f5-4349-9a6e-c19f31f048d0 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:31.797049 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-709f9c95-e0f5-4349-9a6e-c19f31f048d0 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:31.797493 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-709f9c95-e0f5-4349-9a6e-c19f31f048d0 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:31.797908 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-709f9c95-e0f5-4349-9a6e-c19f31f048d0 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:31.927108 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-709f9c95-e0f5-4349-9a6e-c19f31f048d0 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:31.934888 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-709f9c95-e0f5-4349-9a6e-c19f31f048d0 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1566 microversion: 2.1 time: 0.150996 Sep 01 16:42:31.935456 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 516/999] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:31 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:32.956466 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-eec26da0-34a5-414e-820c-d6f6736f69b9 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:32.957116 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-eec26da0-34a5-414e-820c-d6f6736f69b9 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:32.964568 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eec26da0-34a5-414e-820c-d6f6736f69b9 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:32.965058 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eec26da0-34a5-414e-820c-d6f6736f69b9 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:32.965498 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eec26da0-34a5-414e-820c-d6f6736f69b9 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:32.966203 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eec26da0-34a5-414e-820c-d6f6736f69b9 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:32.966684 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eec26da0-34a5-414e-820c-d6f6736f69b9 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:32.967111 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-eec26da0-34a5-414e-820c-d6f6736f69b9 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:33.101279 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-eec26da0-34a5-414e-820c-d6f6736f69b9 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:33.108995 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-eec26da0-34a5-414e-820c-d6f6736f69b9 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1566 microversion: 2.1 time: 0.156635 Sep 01 16:42:33.109557 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 484/1000] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:32 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:34.130315 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cc180e45-af3f-4122-bb8e-f641da01d75e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:34.130916 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cc180e45-af3f-4122-bb8e-f641da01d75e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:34.138152 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc180e45-af3f-4122-bb8e-f641da01d75e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:34.138654 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc180e45-af3f-4122-bb8e-f641da01d75e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:34.139081 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc180e45-af3f-4122-bb8e-f641da01d75e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:34.139765 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc180e45-af3f-4122-bb8e-f641da01d75e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:34.140209 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc180e45-af3f-4122-bb8e-f641da01d75e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:34.140620 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc180e45-af3f-4122-bb8e-f641da01d75e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:34.276188 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cc180e45-af3f-4122-bb8e-f641da01d75e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:34.284025 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cc180e45-af3f-4122-bb8e-f641da01d75e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1507 microversion: 2.1 time: 0.157553 Sep 01 16:42:34.284599 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 517/1001] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:34 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:34.305182 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-2a369c4c-b73d-47aa-9678-40dda201bb8c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:34.305783 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-2a369c4c-b73d-47aa-9678-40dda201bb8c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:34.312317 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a369c4c-b73d-47aa-9678-40dda201bb8c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:34.312805 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a369c4c-b73d-47aa-9678-40dda201bb8c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:34.313248 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a369c4c-b73d-47aa-9678-40dda201bb8c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:34.313942 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a369c4c-b73d-47aa-9678-40dda201bb8c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:34.314424 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a369c4c-b73d-47aa-9678-40dda201bb8c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:34.314853 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2a369c4c-b73d-47aa-9678-40dda201bb8c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:34.343547 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-2a369c4c-b73d-47aa-9678-40dda201bb8c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127178) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 16:42:34.410071 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-2a369c4c-b73d-47aa-9678-40dda201bb8c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "POST /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0/action" status: 202 len: 0 microversion: 2.1 time: 0.109332 Sep 01 16:42:34.410627 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 485/1002] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 1 16:42:34 2022] POST /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:42:34.418832 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f9385b12-a1f4-4c63-a2da-bfeb23e5ab08 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:34.419566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f9385b12-a1f4-4c63-a2da-bfeb23e5ab08 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:34.425754 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9385b12-a1f4-4c63-a2da-bfeb23e5ab08 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:34.426922 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9385b12-a1f4-4c63-a2da-bfeb23e5ab08 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:34.427354 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9385b12-a1f4-4c63-a2da-bfeb23e5ab08 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:34.428063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9385b12-a1f4-4c63-a2da-bfeb23e5ab08 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:34.428516 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9385b12-a1f4-4c63-a2da-bfeb23e5ab08 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:34.429017 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9385b12-a1f4-4c63-a2da-bfeb23e5ab08 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:34.572553 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f9385b12-a1f4-4c63-a2da-bfeb23e5ab08 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:34.580785 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f9385b12-a1f4-4c63-a2da-bfeb23e5ab08 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1515 microversion: 2.1 time: 0.165823 Sep 01 16:42:34.581376 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 518/1003] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:34 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:42:35.410015 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-cb923f11-d77a-4b72-84be-88b76f622748 req-0fec9bc2-2416-435c-8761-80c88888c967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad0df24-0b95-4583-9017-6322bebd55a0", "name": "network-vif-unplugged", "status": "completed", "tag": "85932ff9-5198-4161-a8d5-3f43070b4618"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:35.420251 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-cb923f11-d77a-4b72-84be-88b76f622748 req-0fec9bc2-2416-435c-8761-80c88888c967 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:35.420845 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-cb923f11-d77a-4b72-84be-88b76f622748 req-0fec9bc2-2416-435c-8761-80c88888c967 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:35.421356 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-cb923f11-d77a-4b72-84be-88b76f622748 req-0fec9bc2-2416-435c-8761-80c88888c967 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:35.425354 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:35.434027 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.compute.server_external_events [req-cb923f11-d77a-4b72-84be-88b76f622748 req-0fec9bc2-2416-435c-8761-80c88888c967 service nova] Unable to find a host for instance fad0df24-0b95-4583-9017-6322bebd55a0. Dropping event network-vif-unplugged {{(pid=127178) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 01 16:42:35.434923 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-cb923f11-d77a-4b72-84be-88b76f622748 req-0fec9bc2-2416-435c-8761-80c88888c967 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029305 Sep 01 16:42:35.435509 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 486/1004] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 16:42:35.601290 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b7ef0029-57b5-499f-a1b3-1909d62b7324 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:35.601849 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b7ef0029-57b5-499f-a1b3-1909d62b7324 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:35.608363 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7ef0029-57b5-499f-a1b3-1909d62b7324 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:35.608851 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7ef0029-57b5-499f-a1b3-1909d62b7324 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:35.609279 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7ef0029-57b5-499f-a1b3-1909d62b7324 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:35.609983 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7ef0029-57b5-499f-a1b3-1909d62b7324 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:35.610463 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7ef0029-57b5-499f-a1b3-1909d62b7324 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:35.610881 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7ef0029-57b5-499f-a1b3-1909d62b7324 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:35.746151 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b7ef0029-57b5-499f-a1b3-1909d62b7324 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:35.754446 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b7ef0029-57b5-499f-a1b3-1909d62b7324 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1517 microversion: 2.1 time: 0.157317 Sep 01 16:42:35.755168 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 519/1005] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:35 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:36.776348 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ad109511-5d18-451c-83e2-286950ce983e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:36.776947 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ad109511-5d18-451c-83e2-286950ce983e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:36.784516 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad109511-5d18-451c-83e2-286950ce983e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:36.784995 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad109511-5d18-451c-83e2-286950ce983e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:36.785431 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad109511-5d18-451c-83e2-286950ce983e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:36.786125 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad109511-5d18-451c-83e2-286950ce983e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:36.786597 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad109511-5d18-451c-83e2-286950ce983e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:36.787018 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ad109511-5d18-451c-83e2-286950ce983e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:36.961793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ad109511-5d18-451c-83e2-286950ce983e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:36.969872 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ad109511-5d18-451c-83e2-286950ce983e tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1573 microversion: 2.1 time: 0.197383 Sep 01 16:42:36.970505 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 487/1006] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:36 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1573 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:37.991620 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3e732e19-508d-4e76-bf32-f0b6f8731640 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:37.992262 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3e732e19-508d-4e76-bf32-f0b6f8731640 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:37.999011 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e732e19-508d-4e76-bf32-f0b6f8731640 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:37.999499 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e732e19-508d-4e76-bf32-f0b6f8731640 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:37.999932 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e732e19-508d-4e76-bf32-f0b6f8731640 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:38.000627 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e732e19-508d-4e76-bf32-f0b6f8731640 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:38.001079 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e732e19-508d-4e76-bf32-f0b6f8731640 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:38.001500 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e732e19-508d-4e76-bf32-f0b6f8731640 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:38.130745 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3e732e19-508d-4e76-bf32-f0b6f8731640 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:38.139217 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3e732e19-508d-4e76-bf32-f0b6f8731640 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1573 microversion: 2.1 time: 0.151429 Sep 01 16:42:38.139800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 520/1007] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:37 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:38.375383 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-12dbc192-d4cd-440e-a1f7-fd49417700cb tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:38.375957 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-12dbc192-d4cd-440e-a1f7-fd49417700cb tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:38.382655 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-12dbc192-d4cd-440e-a1f7-fd49417700cb tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:38.383139 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-12dbc192-d4cd-440e-a1f7-fd49417700cb tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:38.383575 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-12dbc192-d4cd-440e-a1f7-fd49417700cb tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:38.384266 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-12dbc192-d4cd-440e-a1f7-fd49417700cb tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:38.384718 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-12dbc192-d4cd-440e-a1f7-fd49417700cb tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:38.385146 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-12dbc192-d4cd-440e-a1f7-fd49417700cb tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:38.408143 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-12dbc192-d4cd-440e-a1f7-fd49417700cb tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff/ips" status: 200 len: 150 microversion: 2.1 time: 0.036714 Sep 01 16:42:38.408716 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 488/1008] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 1 16:42:38 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:39.160512 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2821a522-6e7d-4fe7-b0e9-c6cb5753abac tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:39.161100 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2821a522-6e7d-4fe7-b0e9-c6cb5753abac tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:39.168471 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2821a522-6e7d-4fe7-b0e9-c6cb5753abac tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:39.168961 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2821a522-6e7d-4fe7-b0e9-c6cb5753abac tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:39.169392 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2821a522-6e7d-4fe7-b0e9-c6cb5753abac tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:39.170153 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2821a522-6e7d-4fe7-b0e9-c6cb5753abac tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:39.170638 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2821a522-6e7d-4fe7-b0e9-c6cb5753abac tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:39.171063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2821a522-6e7d-4fe7-b0e9-c6cb5753abac tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:39.305683 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2821a522-6e7d-4fe7-b0e9-c6cb5753abac tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:39.313499 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2821a522-6e7d-4fe7-b0e9-c6cb5753abac tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1573 microversion: 2.1 time: 0.157013 Sep 01 16:42:39.314077 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 521/1009] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:39 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:39.786224 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ba051894-59f2-4024-ba1b-6aeec2b23eab tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b37cbbf-b59d-4205-a7fa-5c86f0e30980"}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:39.788514 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ba051894-59f2-4024-ba1b-6aeec2b23eab tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:39.794860 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ba051894-59f2-4024-ba1b-6aeec2b23eab tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:39.795336 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ba051894-59f2-4024-ba1b-6aeec2b23eab tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:39.795977 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ba051894-59f2-4024-ba1b-6aeec2b23eab tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:39.796661 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ba051894-59f2-4024-ba1b-6aeec2b23eab tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:39.797108 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ba051894-59f2-4024-ba1b-6aeec2b23eab tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:39.797527 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ba051894-59f2-4024-ba1b-6aeec2b23eab tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:40.065821 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ba051894-59f2-4024-ba1b-6aeec2b23eab tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "POST /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283201 Sep 01 16:42:40.066451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 489/1010] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 1 16:42:39 2022] POST /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:40.333905 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-40f19703-ab4a-45d8-989e-2ef68b1fa52c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:40.334546 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-40f19703-ab4a-45d8-989e-2ef68b1fa52c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:40.340974 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40f19703-ab4a-45d8-989e-2ef68b1fa52c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:40.341491 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40f19703-ab4a-45d8-989e-2ef68b1fa52c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:40.341926 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40f19703-ab4a-45d8-989e-2ef68b1fa52c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:40.342643 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40f19703-ab4a-45d8-989e-2ef68b1fa52c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:40.343099 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40f19703-ab4a-45d8-989e-2ef68b1fa52c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:40.343522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40f19703-ab4a-45d8-989e-2ef68b1fa52c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:40.472099 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-40f19703-ab4a-45d8-989e-2ef68b1fa52c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:40.475089 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:40.482284 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-40f19703-ab4a-45d8-989e-2ef68b1fa52c tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1573 microversion: 2.1 time: 0.152134 Sep 01 16:42:40.482873 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 522/1011] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:40 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:41.503978 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-2ca56c13-4fcc-467a-b8da-c444aefa2321 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:41.504595 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-2ca56c13-4fcc-467a-b8da-c444aefa2321 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:41.511624 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2ca56c13-4fcc-467a-b8da-c444aefa2321 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:41.512122 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2ca56c13-4fcc-467a-b8da-c444aefa2321 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:41.512632 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2ca56c13-4fcc-467a-b8da-c444aefa2321 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:41.513336 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2ca56c13-4fcc-467a-b8da-c444aefa2321 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:41.513790 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2ca56c13-4fcc-467a-b8da-c444aefa2321 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:41.514217 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-2ca56c13-4fcc-467a-b8da-c444aefa2321 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:41.648038 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-2ca56c13-4fcc-467a-b8da-c444aefa2321 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:41.655845 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-2ca56c13-4fcc-467a-b8da-c444aefa2321 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1573 microversion: 2.1 time: 0.156243 Sep 01 16:42:41.656404 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 490/1012] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:41 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:42.676878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-fc5c88b8-a16d-4b53-9a26-d3fdde3aa1d1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:42.677476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-fc5c88b8-a16d-4b53-9a26-d3fdde3aa1d1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:42.684228 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fc5c88b8-a16d-4b53-9a26-d3fdde3aa1d1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:42.684700 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fc5c88b8-a16d-4b53-9a26-d3fdde3aa1d1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:42.685124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fc5c88b8-a16d-4b53-9a26-d3fdde3aa1d1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:42.685801 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fc5c88b8-a16d-4b53-9a26-d3fdde3aa1d1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:42.686320 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fc5c88b8-a16d-4b53-9a26-d3fdde3aa1d1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:42.686703 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fc5c88b8-a16d-4b53-9a26-d3fdde3aa1d1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:42.817120 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-fc5c88b8-a16d-4b53-9a26-d3fdde3aa1d1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:42.825455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-fc5c88b8-a16d-4b53-9a26-d3fdde3aa1d1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1573 microversion: 2.1 time: 0.152497 Sep 01 16:42:42.826026 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 523/1013] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:42 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:43.845671 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f05bdf78-5195-4993-ac9f-4035265335cc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:43.846317 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f05bdf78-5195-4993-ac9f-4035265335cc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:43.853721 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f05bdf78-5195-4993-ac9f-4035265335cc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:43.854198 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f05bdf78-5195-4993-ac9f-4035265335cc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:43.854663 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f05bdf78-5195-4993-ac9f-4035265335cc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:43.855361 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f05bdf78-5195-4993-ac9f-4035265335cc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:43.855795 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f05bdf78-5195-4993-ac9f-4035265335cc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:43.856239 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f05bdf78-5195-4993-ac9f-4035265335cc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:43.993464 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f05bdf78-5195-4993-ac9f-4035265335cc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:44.002265 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f05bdf78-5195-4993-ac9f-4035265335cc tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1573 microversion: 2.1 time: 0.160477 Sep 01 16:42:44.002846 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 491/1014] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:43 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:45.023488 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6b65c4fd-3fe4-41e3-8892-59a98fdb7550 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:45.024094 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6b65c4fd-3fe4-41e3-8892-59a98fdb7550 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:45.030578 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6b65c4fd-3fe4-41e3-8892-59a98fdb7550 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:45.031051 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6b65c4fd-3fe4-41e3-8892-59a98fdb7550 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:45.031477 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6b65c4fd-3fe4-41e3-8892-59a98fdb7550 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:45.032161 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6b65c4fd-3fe4-41e3-8892-59a98fdb7550 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:45.032607 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6b65c4fd-3fe4-41e3-8892-59a98fdb7550 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:45.033021 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6b65c4fd-3fe4-41e3-8892-59a98fdb7550 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:45.168810 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6b65c4fd-3fe4-41e3-8892-59a98fdb7550 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:45.176580 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6b65c4fd-3fe4-41e3-8892-59a98fdb7550 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1573 microversion: 2.1 time: 0.156934 Sep 01 16:42:45.177149 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 524/1015] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:45 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:46.197658 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-86efbf12-5701-4d1e-b5cf-2ad0390ebffd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:46.198225 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-86efbf12-5701-4d1e-b5cf-2ad0390ebffd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:46.204923 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-86efbf12-5701-4d1e-b5cf-2ad0390ebffd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:46.205415 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-86efbf12-5701-4d1e-b5cf-2ad0390ebffd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:46.205853 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-86efbf12-5701-4d1e-b5cf-2ad0390ebffd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:46.206577 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-86efbf12-5701-4d1e-b5cf-2ad0390ebffd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:46.207032 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-86efbf12-5701-4d1e-b5cf-2ad0390ebffd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:46.207454 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-86efbf12-5701-4d1e-b5cf-2ad0390ebffd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:46.338170 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-86efbf12-5701-4d1e-b5cf-2ad0390ebffd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:46.346088 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-86efbf12-5701-4d1e-b5cf-2ad0390ebffd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1573 microversion: 2.1 time: 0.152922 Sep 01 16:42:46.346916 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 492/1016] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:46 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:47.368439 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a9fa3e80-f24d-45b3-a2e6-c8eee3b603e1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:47.369048 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a9fa3e80-f24d-45b3-a2e6-c8eee3b603e1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:47.375736 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9fa3e80-f24d-45b3-a2e6-c8eee3b603e1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:47.376221 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9fa3e80-f24d-45b3-a2e6-c8eee3b603e1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:47.376653 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9fa3e80-f24d-45b3-a2e6-c8eee3b603e1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:47.377353 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9fa3e80-f24d-45b3-a2e6-c8eee3b603e1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:47.377805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9fa3e80-f24d-45b3-a2e6-c8eee3b603e1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:47.378280 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9fa3e80-f24d-45b3-a2e6-c8eee3b603e1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:47.499592 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-01d132b6-0368-4a49-922d-1ede27c3429b req-b9b9eef9-5bfb-402d-a686-31cdaa47dadf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad0df24-0b95-4583-9017-6322bebd55a0", "name": "network-vif-plugged", "status": "completed", "tag": "85932ff9-5198-4161-a8d5-3f43070b4618"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:47.512367 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-01d132b6-0368-4a49-922d-1ede27c3429b req-b9b9eef9-5bfb-402d-a686-31cdaa47dadf service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:47.512515 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a9fa3e80-f24d-45b3-a2e6-c8eee3b603e1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:47.512878 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-01d132b6-0368-4a49-922d-1ede27c3429b req-b9b9eef9-5bfb-402d-a686-31cdaa47dadf service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:47.513950 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-01d132b6-0368-4a49-922d-1ede27c3429b req-b9b9eef9-5bfb-402d-a686-31cdaa47dadf service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:47.520492 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a9fa3e80-f24d-45b3-a2e6-c8eee3b603e1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1573 microversion: 2.1 time: 0.156444 Sep 01 16:42:47.526431 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-01d132b6-0368-4a49-922d-1ede27c3429b req-b9b9eef9-5bfb-402d-a686-31cdaa47dadf service nova] Creating event network-vif-plugged:85932ff9-5198-4161-a8d5-3f43070b4618 for instance fad0df24-0b95-4583-9017-6322bebd55a0 on hv-cinder-85220 Sep 01 16:42:47.531666 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-01d132b6-0368-4a49-922d-1ede27c3429b req-b9b9eef9-5bfb-402d-a686-31cdaa47dadf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035688 Sep 01 16:42:47.532729 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 493/1017] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:42:47.533754 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 525/1018] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:47 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:47.624762 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-8e945fce-cc18-4124-882c-5b767316f881 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Action: 'create', calling method: .version_select at 0x7feeec12c8b0>, body: {"keypair": {"name": "tempest-keypair-1127395187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRuys+WphvvvZHEJEScliw+/CVyvGc/0CeCnDGkeH6NT4Av3TvGZesc3RzWElkAHYwVKYRjLF0C0VkAaJc2jr/+Odigy24ymg4sSTQFXAov7dfto03iIVamnSiFKnTTdA=="}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:47.640599 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-8e945fce-cc18-4124-882c-5b767316f881 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Getting quotas for project 9b9aa20e1ffb453d9ee13dd6ae2c25ef. Resources: {'key_pairs'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:42:47.644587 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-8e945fce-cc18-4124-882c-5b767316f881 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Getting quotas for user a237b400429f4200909581e3c5e0cbfb and project 9b9aa20e1ffb453d9ee13dd6ae2c25ef. Resources: {'key_pairs'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:42:47.666778 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-8e945fce-cc18-4124-882c-5b767316f881 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046223 Sep 01 16:42:47.667369 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 494/1019] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 1 16:42:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:48.541324 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a9db450e-90ed-4ad1-af2f-6c459b8cde9f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:48.542017 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a9db450e-90ed-4ad1-af2f-6c459b8cde9f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:48.548961 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9db450e-90ed-4ad1-af2f-6c459b8cde9f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:48.549445 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9db450e-90ed-4ad1-af2f-6c459b8cde9f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:48.549876 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9db450e-90ed-4ad1-af2f-6c459b8cde9f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:48.550611 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9db450e-90ed-4ad1-af2f-6c459b8cde9f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:48.551057 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9db450e-90ed-4ad1-af2f-6c459b8cde9f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:48.551471 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9db450e-90ed-4ad1-af2f-6c459b8cde9f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:48.700788 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a9db450e-90ed-4ad1-af2f-6c459b8cde9f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:48.709796 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a9db450e-90ed-4ad1-af2f-6c459b8cde9f tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1573 microversion: 2.1 time: 0.172557 Sep 01 16:42:48.710319 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 526/1020] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:48 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:49.019383 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-986956605", "imageRef": "46185d58-0d47-4c97-b590-0f4434aa5c9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae0395ee-74d9-4949-89c6-cf6ebc736a46"}], "security_groups": [{"name": "tempest-securitygroup--839122187"}], "key_name": "tempest-keypair-1127395187", "user_data": "}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:49.028107 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:49.135141 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.network.neutron [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] validate_networks() for [('ae0395ee-74d9-4949-89c6-cf6ebc736a46', None, None, None, None, None)] {{(pid=127178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:42:49.507915 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Flavor limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:42:49.508333 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Image limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:42:49.508801 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Flavor pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:42:49.509202 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Image pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:42:49.509606 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:42:49.518361 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:49.518833 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:49.519263 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:49.519972 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:49.520412 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:49.520827 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:49.538310 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Getting quotas for project 9b9aa20e1ffb453d9ee13dd6ae2c25ef. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:42:49.542195 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Getting quotas for user a237b400429f4200909581e3c5e0cbfb and project 9b9aa20e1ffb453d9ee13dd6ae2c25ef. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:42:49.553057 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Going to run 1 instances... {{(pid=127178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:42:49.555479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46185d58-0d47-4c97-b590-0f4434aa5c9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:42:49.606505 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-bd0d1b2e-e167-4134-b009-e967748c9828 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.591657 Sep 01 16:42:49.607268 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 495/1021] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:42:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:42:49.618545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9d26f75d-3b65-4d1a-8ec7-94cae81cecb5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:49.619186 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9d26f75d-3b65-4d1a-8ec7-94cae81cecb5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:49.677792 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9d26f75d-3b65-4d1a-8ec7-94cae81cecb5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:49.684872 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9d26f75d-3b65-4d1a-8ec7-94cae81cecb5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d" status: 200 len: 1241 microversion: 2.1 time: 0.070350 Sep 01 16:42:49.685451 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 527/1022] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:49 2022] GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:49.730960 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a888f8a6-07d2-44d4-88ea-7fc7cb399289 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:49.731680 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a888f8a6-07d2-44d4-88ea-7fc7cb399289 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:49.738983 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a888f8a6-07d2-44d4-88ea-7fc7cb399289 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:49.739469 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a888f8a6-07d2-44d4-88ea-7fc7cb399289 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:49.740413 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a888f8a6-07d2-44d4-88ea-7fc7cb399289 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:49.741109 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a888f8a6-07d2-44d4-88ea-7fc7cb399289 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:49.741590 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a888f8a6-07d2-44d4-88ea-7fc7cb399289 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:49.742017 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a888f8a6-07d2-44d4-88ea-7fc7cb399289 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:49.879976 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a888f8a6-07d2-44d4-88ea-7fc7cb399289 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:49.889359 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a888f8a6-07d2-44d4-88ea-7fc7cb399289 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1560 microversion: 2.1 time: 0.162101 Sep 01 16:42:49.890059 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 496/1023] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:49 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:50.705885 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ab9b03c5-6ec4-41b3-8793-156f6dc864d3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:50.706474 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ab9b03c5-6ec4-41b3-8793-156f6dc864d3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:50.713492 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab9b03c5-6ec4-41b3-8793-156f6dc864d3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:50.713979 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab9b03c5-6ec4-41b3-8793-156f6dc864d3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:50.714512 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab9b03c5-6ec4-41b3-8793-156f6dc864d3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:50.715212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab9b03c5-6ec4-41b3-8793-156f6dc864d3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:50.715661 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab9b03c5-6ec4-41b3-8793-156f6dc864d3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:50.716079 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab9b03c5-6ec4-41b3-8793-156f6dc864d3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:50.780953 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ab9b03c5-6ec4-41b3-8793-156f6dc864d3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:50.789401 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ab9b03c5-6ec4-41b3-8793-156f6dc864d3 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d" status: 200 len: 1293 microversion: 2.1 time: 0.087385 Sep 01 16:42:50.789986 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 528/1024] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:50 2022] GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:51.812098 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a72fc1ed-818b-4e64-b46e-71064c927f5d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:51.812705 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a72fc1ed-818b-4e64-b46e-71064c927f5d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:51.820812 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a72fc1ed-818b-4e64-b46e-71064c927f5d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:51.821488 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a72fc1ed-818b-4e64-b46e-71064c927f5d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:51.822194 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a72fc1ed-818b-4e64-b46e-71064c927f5d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:51.822984 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a72fc1ed-818b-4e64-b46e-71064c927f5d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:51.823441 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a72fc1ed-818b-4e64-b46e-71064c927f5d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:51.823862 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a72fc1ed-818b-4e64-b46e-71064c927f5d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:52.340433 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a72fc1ed-818b-4e64-b46e-71064c927f5d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:52.348757 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a72fc1ed-818b-4e64-b46e-71064c927f5d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d" status: 200 len: 1366 microversion: 2.1 time: 0.540781 Sep 01 16:42:52.352515 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 497/1025] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:51 2022] GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d => generated 1366 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:52.667624 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-fa07244a-5296-49fb-99d5-6e988171697d req-5a19e315-0259-4881-b460-172758051071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3520487-5780-44b3-9e04-28492a42939d", "tag": "4b66e1df-e040-432a-9d26-fef8d6c98bcf"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:52.674304 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=42 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:52.681001 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-fa07244a-5296-49fb-99d5-6e988171697d req-5a19e315-0259-4881-b460-172758051071 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:52.681579 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-fa07244a-5296-49fb-99d5-6e988171697d req-5a19e315-0259-4881-b460-172758051071 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:52.682674 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-fa07244a-5296-49fb-99d5-6e988171697d req-5a19e315-0259-4881-b460-172758051071 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:52.703753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-fa07244a-5296-49fb-99d5-6e988171697d req-5a19e315-0259-4881-b460-172758051071 service nova] Creating event network-changed:4b66e1df-e040-432a-9d26-fef8d6c98bcf for instance d3520487-5780-44b3-9e04-28492a42939d on hv-cinder-85220 Sep 01 16:42:52.708857 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-fa07244a-5296-49fb-99d5-6e988171697d req-5a19e315-0259-4881-b460-172758051071 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045190 Sep 01 16:42:52.709777 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 529/1026] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:53.371048 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-74567197-8ace-48de-a048-bd302ad86213 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:53.371658 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-74567197-8ace-48de-a048-bd302ad86213 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:53.378062 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-74567197-8ace-48de-a048-bd302ad86213 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:53.378582 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-74567197-8ace-48de-a048-bd302ad86213 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:53.379018 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-74567197-8ace-48de-a048-bd302ad86213 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:53.379704 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-74567197-8ace-48de-a048-bd302ad86213 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:53.380152 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-74567197-8ace-48de-a048-bd302ad86213 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:53.381219 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-74567197-8ace-48de-a048-bd302ad86213 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:53.509844 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-74567197-8ace-48de-a048-bd302ad86213 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:53.517507 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-74567197-8ace-48de-a048-bd302ad86213 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d" status: 200 len: 1366 microversion: 2.1 time: 0.150384 Sep 01 16:42:53.518070 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 498/1027] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:53 2022] GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:54.539987 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-414c52ff-6b8f-4bcf-adcf-0f4528aef44d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:54.540604 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-414c52ff-6b8f-4bcf-adcf-0f4528aef44d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:54.546938 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-414c52ff-6b8f-4bcf-adcf-0f4528aef44d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:54.547422 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-414c52ff-6b8f-4bcf-adcf-0f4528aef44d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:54.547849 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-414c52ff-6b8f-4bcf-adcf-0f4528aef44d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:54.548534 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-414c52ff-6b8f-4bcf-adcf-0f4528aef44d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:54.548982 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-414c52ff-6b8f-4bcf-adcf-0f4528aef44d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:54.549395 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-414c52ff-6b8f-4bcf-adcf-0f4528aef44d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:54.682577 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-414c52ff-6b8f-4bcf-adcf-0f4528aef44d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:54.690395 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-414c52ff-6b8f-4bcf-adcf-0f4528aef44d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d" status: 200 len: 1366 microversion: 2.1 time: 0.155571 Sep 01 16:42:54.690968 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 530/1028] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:54 2022] GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:55.492797 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-29b2a395-49a7-4b9a-8f72-f535f20605b2 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1212051678"}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:55.493332 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-29b2a395-49a7-4b9a-8f72-f535f20605b2 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:55.500473 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-29b2a395-49a7-4b9a-8f72-f535f20605b2 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:55.500957 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-29b2a395-49a7-4b9a-8f72-f535f20605b2 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:55.501387 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-29b2a395-49a7-4b9a-8f72-f535f20605b2 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:55.502079 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-29b2a395-49a7-4b9a-8f72-f535f20605b2 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:55.502552 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-29b2a395-49a7-4b9a-8f72-f535f20605b2 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:55.502970 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-29b2a395-49a7-4b9a-8f72-f535f20605b2 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:55.633775 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.network.security_group_api [None req-29b2a395-49a7-4b9a-8f72-f535f20605b2 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Removing security group 540127ec-4e23-4f73-a15d-88ab904e2328 from port 229f7341-6966-4b67-9657-ed92a6db27a4 Sep 01 16:42:55.712403 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f854d6d7-13c7-4a03-820f-36c6d7e935fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:55.713127 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f854d6d7-13c7-4a03-820f-36c6d7e935fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:55.719511 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f854d6d7-13c7-4a03-820f-36c6d7e935fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:55.720257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f854d6d7-13c7-4a03-820f-36c6d7e935fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:55.720905 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f854d6d7-13c7-4a03-820f-36c6d7e935fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:55.722325 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f854d6d7-13c7-4a03-820f-36c6d7e935fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:55.723012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f854d6d7-13c7-4a03-820f-36c6d7e935fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:55.723493 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f854d6d7-13c7-4a03-820f-36c6d7e935fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:55.869830 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f854d6d7-13c7-4a03-820f-36c6d7e935fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:55.878281 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f854d6d7-13c7-4a03-820f-36c6d7e935fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d" status: 200 len: 1366 microversion: 2.1 time: 0.169589 Sep 01 16:42:55.879086 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 531/1029] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:55 2022] GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:42:55.988392 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-29b2a395-49a7-4b9a-8f72-f535f20605b2 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "POST /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/action" status: 202 len: 0 microversion: 2.1 time: 0.499909 Sep 01 16:42:55.989003 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 499/1030] 10.222.0.18 () {60 vars in 1278 bytes} [Thu Sep 1 16:42:55 2022] POST /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:42:56.006228 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-52c114c4-a127-42bc-ad08-d721456a346e req-5cf2c5a5-985e-4eb6-9d34-382f1676bc72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840b3e8c-3b9a-44ee-8f03-43d332ca8b26", "tag": "229f7341-6966-4b67-9657-ed92a6db27a4"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:56.018557 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-52c114c4-a127-42bc-ad08-d721456a346e req-5cf2c5a5-985e-4eb6-9d34-382f1676bc72 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:56.019720 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-52c114c4-a127-42bc-ad08-d721456a346e req-5cf2c5a5-985e-4eb6-9d34-382f1676bc72 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:56.020149 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-52c114c4-a127-42bc-ad08-d721456a346e req-5cf2c5a5-985e-4eb6-9d34-382f1676bc72 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:56.035844 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-52c114c4-a127-42bc-ad08-d721456a346e req-5cf2c5a5-985e-4eb6-9d34-382f1676bc72 service nova] Creating event network-changed:229f7341-6966-4b67-9657-ed92a6db27a4 for instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 on hv-cinder-85220 Sep 01 16:42:56.042574 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-52c114c4-a127-42bc-ad08-d721456a346e req-5cf2c5a5-985e-4eb6-9d34-382f1676bc72 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041774 Sep 01 16:42:56.044414 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 532/1031] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:56.901798 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c1a94076-ce2d-4fb3-abfd-bd47197e9ffa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:56.902520 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c1a94076-ce2d-4fb3-abfd-bd47197e9ffa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:56.908753 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c1a94076-ce2d-4fb3-abfd-bd47197e9ffa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:56.909237 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c1a94076-ce2d-4fb3-abfd-bd47197e9ffa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:56.909700 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c1a94076-ce2d-4fb3-abfd-bd47197e9ffa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:56.910453 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c1a94076-ce2d-4fb3-abfd-bd47197e9ffa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:56.910899 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c1a94076-ce2d-4fb3-abfd-bd47197e9ffa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:56.911726 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c1a94076-ce2d-4fb3-abfd-bd47197e9ffa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:57.044180 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-c1a94076-ce2d-4fb3-abfd-bd47197e9ffa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:57.052404 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c1a94076-ce2d-4fb3-abfd-bd47197e9ffa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d" status: 200 len: 1366 microversion: 2.1 time: 0.156145 Sep 01 16:42:57.052968 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 500/1032] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:56 2022] GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:57.267119 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-05af3cfc-ad0f-4a7f-a796-d729910c8aa8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:57.267818 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-05af3cfc-ad0f-4a7f-a796-d729910c8aa8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:57.268437 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-1a944ef9-4538-4ab1-9baa-8da61e29315b req-7a819531-d8a1-4b04-8219-5e83b57a28cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840b3e8c-3b9a-44ee-8f03-43d332ca8b26", "tag": "229f7341-6966-4b67-9657-ed92a6db27a4"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:57.274884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05af3cfc-ad0f-4a7f-a796-d729910c8aa8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:57.275504 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05af3cfc-ad0f-4a7f-a796-d729910c8aa8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:57.276085 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05af3cfc-ad0f-4a7f-a796-d729910c8aa8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:57.276881 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05af3cfc-ad0f-4a7f-a796-d729910c8aa8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:57.277455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05af3cfc-ad0f-4a7f-a796-d729910c8aa8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:57.277949 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05af3cfc-ad0f-4a7f-a796-d729910c8aa8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:57.282915 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-1a944ef9-4538-4ab1-9baa-8da61e29315b req-7a819531-d8a1-4b04-8219-5e83b57a28cd service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:57.283582 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-1a944ef9-4538-4ab1-9baa-8da61e29315b req-7a819531-d8a1-4b04-8219-5e83b57a28cd service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:57.284217 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-1a944ef9-4538-4ab1-9baa-8da61e29315b req-7a819531-d8a1-4b04-8219-5e83b57a28cd service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:57.298299 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-1a944ef9-4538-4ab1-9baa-8da61e29315b req-7a819531-d8a1-4b04-8219-5e83b57a28cd service nova] Creating event network-changed:229f7341-6966-4b67-9657-ed92a6db27a4 for instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 on hv-cinder-85220 Sep 01 16:42:57.304238 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-1a944ef9-4538-4ab1-9baa-8da61e29315b req-7a819531-d8a1-4b04-8219-5e83b57a28cd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039796 Sep 01 16:42:57.304944 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 501/1033] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:57.377747 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-05af3cfc-ad0f-4a7f-a796-d729910c8aa8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lazy-loading 'services' on Instance uuid 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:42:57.454312 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-05af3cfc-ad0f-4a7f-a796-d729910c8aa8 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "DELETE /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/os-volume_attachments/8baf7fb2-12d8-4296-9e7d-4e462c968309" status: 202 len: 0 microversion: 2.1 time: 0.191497 Sep 01 16:42:57.455187 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 533/1034] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 1 16:42:57 2022] DELETE /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/os-volume_attachments/8baf7fb2-12d8-4296-9e7d-4e462c968309 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:42:57.465017 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-48795571-d19a-4822-8b6c-dc60c6446a9f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:57.467539 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-48795571-d19a-4822-8b6c-dc60c6446a9f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:57.482187 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48795571-d19a-4822-8b6c-dc60c6446a9f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:57.483041 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48795571-d19a-4822-8b6c-dc60c6446a9f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:57.484033 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48795571-d19a-4822-8b6c-dc60c6446a9f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:57.484804 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48795571-d19a-4822-8b6c-dc60c6446a9f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:57.485262 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48795571-d19a-4822-8b6c-dc60c6446a9f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:57.485689 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-48795571-d19a-4822-8b6c-dc60c6446a9f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:57.539539 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-48795571-d19a-4822-8b6c-dc60c6446a9f tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078777 Sep 01 16:42:57.540117 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 502/1035] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:42:57 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:57.763740 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-ff5d4aae-85cf-4c30-920d-2f21f5eb251c req-0e3e22d9-6674-4ce5-b96b-5366dee6f01b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3520487-5780-44b3-9e04-28492a42939d", "name": "network-vif-plugged", "status": "completed", "tag": "4b66e1df-e040-432a-9d26-fef8d6c98bcf"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:57.773994 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-ff5d4aae-85cf-4c30-920d-2f21f5eb251c req-0e3e22d9-6674-4ce5-b96b-5366dee6f01b service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:57.774548 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-ff5d4aae-85cf-4c30-920d-2f21f5eb251c req-0e3e22d9-6674-4ce5-b96b-5366dee6f01b service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:57.775026 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-ff5d4aae-85cf-4c30-920d-2f21f5eb251c req-0e3e22d9-6674-4ce5-b96b-5366dee6f01b service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:57.786686 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-ff5d4aae-85cf-4c30-920d-2f21f5eb251c req-0e3e22d9-6674-4ce5-b96b-5366dee6f01b service nova] Creating event network-vif-plugged:4b66e1df-e040-432a-9d26-fef8d6c98bcf for instance d3520487-5780-44b3-9e04-28492a42939d on hv-cinder-85220 Sep 01 16:42:57.791475 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-ff5d4aae-85cf-4c30-920d-2f21f5eb251c req-0e3e22d9-6674-4ce5-b96b-5366dee6f01b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032084 Sep 01 16:42:57.792105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 534/1036] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:42:58.073845 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d84592b3-5deb-4259-aef2-6b2b00978d10 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:58.074452 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d84592b3-5deb-4259-aef2-6b2b00978d10 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:58.086536 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d84592b3-5deb-4259-aef2-6b2b00978d10 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:58.087635 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d84592b3-5deb-4259-aef2-6b2b00978d10 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:58.088846 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d84592b3-5deb-4259-aef2-6b2b00978d10 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:58.089766 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d84592b3-5deb-4259-aef2-6b2b00978d10 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:58.090562 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d84592b3-5deb-4259-aef2-6b2b00978d10 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:58.091381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d84592b3-5deb-4259-aef2-6b2b00978d10 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:58.367675 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-d84592b3-5deb-4259-aef2-6b2b00978d10 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:58.375242 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d84592b3-5deb-4259-aef2-6b2b00978d10 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d" status: 200 len: 1366 microversion: 2.1 time: 0.305446 Sep 01 16:42:58.375898 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 503/1037] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:58 2022] GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:58.552945 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c5b23107-1db1-43a5-a05d-69436603fca9 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:58.555486 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c5b23107-1db1-43a5-a05d-69436603fca9 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:58.561902 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5b23107-1db1-43a5-a05d-69436603fca9 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:58.562417 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5b23107-1db1-43a5-a05d-69436603fca9 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:58.562854 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5b23107-1db1-43a5-a05d-69436603fca9 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:58.563585 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5b23107-1db1-43a5-a05d-69436603fca9 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:58.564033 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5b23107-1db1-43a5-a05d-69436603fca9 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:58.564448 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5b23107-1db1-43a5-a05d-69436603fca9 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:58.595731 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c5b23107-1db1-43a5-a05d-69436603fca9 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047660 Sep 01 16:42:58.596292 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 535/1038] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:42:58 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:59.395817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-99a3ed69-1c88-43e8-947e-0bfab6e66ce4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:59.396418 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-99a3ed69-1c88-43e8-947e-0bfab6e66ce4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:59.403062 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-99a3ed69-1c88-43e8-947e-0bfab6e66ce4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:59.403535 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-99a3ed69-1c88-43e8-947e-0bfab6e66ce4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:59.403963 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-99a3ed69-1c88-43e8-947e-0bfab6e66ce4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:59.404647 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-99a3ed69-1c88-43e8-947e-0bfab6e66ce4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:59.405089 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-99a3ed69-1c88-43e8-947e-0bfab6e66ce4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:59.405503 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-99a3ed69-1c88-43e8-947e-0bfab6e66ce4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:59.529338 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:59.548029 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-99a3ed69-1c88-43e8-947e-0bfab6e66ce4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:59.550211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=10 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:59.558029 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-99a3ed69-1c88-43e8-947e-0bfab6e66ce4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d" status: 200 len: 1366 microversion: 2.1 time: 0.166023 Sep 01 16:42:59.558873 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 504/1039] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:59 2022] GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:59.608392 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-931aaf65-1551-466f-8480-e5eb5c3ce510 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:59.610610 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-931aaf65-1551-466f-8480-e5eb5c3ce510 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:59.617763 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-931aaf65-1551-466f-8480-e5eb5c3ce510 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:59.618260 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-931aaf65-1551-466f-8480-e5eb5c3ce510 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:59.618691 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-931aaf65-1551-466f-8480-e5eb5c3ce510 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:59.619427 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-931aaf65-1551-466f-8480-e5eb5c3ce510 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:59.619822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-931aaf65-1551-466f-8480-e5eb5c3ce510 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:59.620235 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-931aaf65-1551-466f-8480-e5eb5c3ce510 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:59.651493 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-931aaf65-1551-466f-8480-e5eb5c3ce510 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047057 Sep 01 16:42:59.653645 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 536/1040] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:42:59 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:42:59.664927 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c6b7e03c-8ec1-4ca6-a394-f57a41b92769 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:59.665418 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c6b7e03c-8ec1-4ca6-a394-f57a41b92769 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:59.671488 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c6b7e03c-8ec1-4ca6-a394-f57a41b92769 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:59.671970 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c6b7e03c-8ec1-4ca6-a394-f57a41b92769 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:59.672404 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c6b7e03c-8ec1-4ca6-a394-f57a41b92769 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:59.673094 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c6b7e03c-8ec1-4ca6-a394-f57a41b92769 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:59.673545 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c6b7e03c-8ec1-4ca6-a394-f57a41b92769 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:59.673969 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c6b7e03c-8ec1-4ca6-a394-f57a41b92769 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:59.746476 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:59.752852 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-c6b7e03c-8ec1-4ca6-a394-f57a41b92769 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] HTTP exception thrown: Instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 is not attached to volume 8baf7fb2-12d8-4296-9e7d-4e462c968309 Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c6b7e03c-8ec1-4ca6-a394-f57a41b92769 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Request method failure captured: Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: DELETE /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/os-volume_attachments/8baf7fb2-12d8-4296-9e7d-4e462c968309 HTTP/1.1 Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEOCMZmgmEYQpypp-6El2_UlfM7l1MH0iMcQPEqTtoBl07J2TPH0Zb99r_DsYOVR4yCPbpOZR8xTPpFhppG4OKbO41VU6gcXj7AWt_TSWJRga8ZPi9MhCNe-EmroQZEJQfT5Bj-Vc9QaO-LrOY7q-z4anhJPQF3XTf1gKp2_3Uhj8pmw Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: 13ab20a85384485e95e2c0dadcc8b43c Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-TestMinimumBasicScenario-1697085018 Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:42:59.755352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:42:59.757077 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/13ab20a85384485e95e2c0dadcc8b43c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_13ab20a85384485e95e2c0dadcc8b43c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/13ab20a85384485e95e2c0dadcc8b43c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/13ab20a85384485e95e2c0dadcc8b43c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:42:59.757077 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-TestMinimumBasicScenario-1697085018 Sep 01 16:42:59.757077 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: 13ab20a85384485e95e2c0dadcc8b43c Sep 01 16:42:59.757077 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1697085018 Sep 01 16:42:59.757077 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-TestMinimumBasicScenario-1697085018-project Sep 01 16:42:59.757077 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:42:59.757077 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:42:59.757077 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: 003d7b8eee13419780bb5e055a01bb77 Sep 01 16:42:59.757077 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-TestMinimumBasicScenario-1697085018-project Sep 01 16:42:59.757077 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:42:59.757077 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 is not attached to volume 8baf7fb2-12d8-4296-9e7d-4e462c968309 Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'server_id': '840b3e8c-3b9a-44ee-8f03-43d332ca8b26', 'id': '8baf7fb2-12d8-4296-9e7d-4e462c968309'} Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8baf7fb2-12d8-4296-9e7d-4e462c968309. Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:59.758120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:59.759741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:59.759741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 16:42:59.759741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 16:42:59.759741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 is not attached to volume 8baf7fb2-12d8-4296-9e7d-4e462c968309 Sep 01 16:42:59.759741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:42:59.759741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:59.759741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:42:59.759741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:59.759741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:59.759741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:59.759741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:59.759741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:59.759741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 is not attached to volume 8baf7fb2-12d8-4296-9e7d-4e462c968309 Sep 01 16:42:59.759741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:42:59.759741 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c6b7e03c-8ec1-4ca6-a394-f57a41b92769 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Returning 404 to user: Instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 is not attached to volume 8baf7fb2-12d8-4296-9e7d-4e462c968309 {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:59.760924 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c6b7e03c-8ec1-4ca6-a394-f57a41b92769 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "DELETE /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/os-volume_attachments/8baf7fb2-12d8-4296-9e7d-4e462c968309" status: 404 len: 154 microversion: 2.1 time: 0.096513 Sep 01 16:42:59.760924 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 505/1041] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 1 16:42:59 2022] DELETE /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26/os-volume_attachments/8baf7fb2-12d8-4296-9e7d-4e462c968309 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:43:00.580800 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4bf483cb-0b29-490e-9c46-a205c8eb85c9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:00.581401 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4bf483cb-0b29-490e-9c46-a205c8eb85c9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:00.583538 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:00.588987 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bf483cb-0b29-490e-9c46-a205c8eb85c9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:00.589460 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bf483cb-0b29-490e-9c46-a205c8eb85c9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:00.589882 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bf483cb-0b29-490e-9c46-a205c8eb85c9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:00.590592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bf483cb-0b29-490e-9c46-a205c8eb85c9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:00.591034 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bf483cb-0b29-490e-9c46-a205c8eb85c9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:00.591453 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bf483cb-0b29-490e-9c46-a205c8eb85c9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:00.719007 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4bf483cb-0b29-490e-9c46-a205c8eb85c9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:00.727172 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4bf483cb-0b29-490e-9c46-a205c8eb85c9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d" status: 200 len: 1556 microversion: 2.1 time: 0.150296 Sep 01 16:43:00.727728 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 537/1042] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:00 2022] GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:00.747973 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-3999fb0d-83d9-4ce3-9ef7-652b870a6f85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:00.748521 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-3999fb0d-83d9-4ce3-9ef7-652b870a6f85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:00.755929 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3999fb0d-83d9-4ce3-9ef7-652b870a6f85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:00.756414 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3999fb0d-83d9-4ce3-9ef7-652b870a6f85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:00.756849 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3999fb0d-83d9-4ce3-9ef7-652b870a6f85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:00.757557 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3999fb0d-83d9-4ce3-9ef7-652b870a6f85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:00.757988 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3999fb0d-83d9-4ce3-9ef7-652b870a6f85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:00.758452 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3999fb0d-83d9-4ce3-9ef7-652b870a6f85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:00.837088 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-3999fb0d-83d9-4ce3-9ef7-652b870a6f85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092956 Sep 01 16:43:00.837670 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 506/1043] 10.222.0.18 () {58 vars in 1275 bytes} [Thu Sep 1 16:43:00 2022] GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:00.902318 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ff52354e-4496-4c7e-b984-893de1cf3098 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:00.902896 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ff52354e-4496-4c7e-b984-893de1cf3098 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:00.909338 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff52354e-4496-4c7e-b984-893de1cf3098 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:00.909908 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff52354e-4496-4c7e-b984-893de1cf3098 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:00.910362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff52354e-4496-4c7e-b984-893de1cf3098 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:00.911064 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff52354e-4496-4c7e-b984-893de1cf3098 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:00.912099 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff52354e-4496-4c7e-b984-893de1cf3098 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:00.912525 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff52354e-4496-4c7e-b984-893de1cf3098 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:00.939994 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ff52354e-4496-4c7e-b984-893de1cf3098 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:43:01.016722 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ff52354e-4496-4c7e-b984-893de1cf3098 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "DELETE /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 204 len: 0 microversion: 2.1 time: 0.118357 Sep 01 16:43:01.017627 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 538/1044] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:43:00 2022] DELETE /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:43:01.026605 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-3791036a-58dd-42ff-b272-fb63ddab5dcc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:01.027211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-3791036a-58dd-42ff-b272-fb63ddab5dcc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:01.034267 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3791036a-58dd-42ff-b272-fb63ddab5dcc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:01.034798 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3791036a-58dd-42ff-b272-fb63ddab5dcc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:01.035235 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3791036a-58dd-42ff-b272-fb63ddab5dcc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:01.035933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3791036a-58dd-42ff-b272-fb63ddab5dcc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:01.036970 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3791036a-58dd-42ff-b272-fb63ddab5dcc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:01.037446 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3791036a-58dd-42ff-b272-fb63ddab5dcc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:01.271088 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-3791036a-58dd-42ff-b272-fb63ddab5dcc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:01.278922 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-3791036a-58dd-42ff-b272-fb63ddab5dcc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1554 microversion: 2.1 time: 0.256348 Sep 01 16:43:01.279485 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 507/1045] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:01 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1554 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:01.835508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-3b299786-433c-4d35-a66e-0c2cc6dbf231 req-e64a706e-b4ed-45b3-a081-d015518e8374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3520487-5780-44b3-9e04-28492a42939d", "tag": "4b66e1df-e040-432a-9d26-fef8d6c98bcf"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:01.845472 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-3b299786-433c-4d35-a66e-0c2cc6dbf231 req-e64a706e-b4ed-45b3-a081-d015518e8374 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:01.845951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-3b299786-433c-4d35-a66e-0c2cc6dbf231 req-e64a706e-b4ed-45b3-a081-d015518e8374 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:01.846404 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-3b299786-433c-4d35-a66e-0c2cc6dbf231 req-e64a706e-b4ed-45b3-a081-d015518e8374 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:01.857933 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-3b299786-433c-4d35-a66e-0c2cc6dbf231 req-e64a706e-b4ed-45b3-a081-d015518e8374 service nova] Creating event network-changed:4b66e1df-e040-432a-9d26-fef8d6c98bcf for instance d3520487-5780-44b3-9e04-28492a42939d on hv-cinder-85220 Sep 01 16:43:01.863139 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-3b299786-433c-4d35-a66e-0c2cc6dbf231 req-e64a706e-b4ed-45b3-a081-d015518e8374 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031592 Sep 01 16:43:01.863944 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 539/1046] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:02.300082 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7fe8ef2f-e658-4d6f-97d4-ce6e3c73b3cf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:02.300716 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7fe8ef2f-e658-4d6f-97d4-ce6e3c73b3cf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:02.307225 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7fe8ef2f-e658-4d6f-97d4-ce6e3c73b3cf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:02.307695 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7fe8ef2f-e658-4d6f-97d4-ce6e3c73b3cf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:02.308135 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7fe8ef2f-e658-4d6f-97d4-ce6e3c73b3cf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:02.308830 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7fe8ef2f-e658-4d6f-97d4-ce6e3c73b3cf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:02.309278 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7fe8ef2f-e658-4d6f-97d4-ce6e3c73b3cf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:02.309703 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7fe8ef2f-e658-4d6f-97d4-ce6e3c73b3cf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:02.443622 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-7fe8ef2f-e658-4d6f-97d4-ce6e3c73b3cf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:02.451438 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7fe8ef2f-e658-4d6f-97d4-ce6e3c73b3cf tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1554 microversion: 2.1 time: 0.155163 Sep 01 16:43:02.452016 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 508/1047] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:02 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:03.474726 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-857d0acb-dd4e-4547-8eac-3c938509af96 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:03.475326 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-857d0acb-dd4e-4547-8eac-3c938509af96 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:03.481735 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-857d0acb-dd4e-4547-8eac-3c938509af96 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:03.482226 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-857d0acb-dd4e-4547-8eac-3c938509af96 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:03.482687 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-857d0acb-dd4e-4547-8eac-3c938509af96 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:03.483398 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-857d0acb-dd4e-4547-8eac-3c938509af96 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:03.483848 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-857d0acb-dd4e-4547-8eac-3c938509af96 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:03.484266 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-857d0acb-dd4e-4547-8eac-3c938509af96 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:03.622922 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-857d0acb-dd4e-4547-8eac-3c938509af96 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:03.625221 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:03.632233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-857d0acb-dd4e-4547-8eac-3c938509af96 tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1554 microversion: 2.1 time: 0.162903 Sep 01 16:43:03.632815 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 540/1048] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:03 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:04.101048 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-0deeab54-1973-409d-9ed0-a7df5afcdfea req-c2f4c6e5-22b1-43d5-9510-7101bcc61ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "840b3e8c-3b9a-44ee-8f03-43d332ca8b26", "name": "network-vif-deleted", "tag": "229f7341-6966-4b67-9657-ed92a6db27a4"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:04.111802 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-0deeab54-1973-409d-9ed0-a7df5afcdfea req-c2f4c6e5-22b1-43d5-9510-7101bcc61ee2 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:04.112277 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-0deeab54-1973-409d-9ed0-a7df5afcdfea req-c2f4c6e5-22b1-43d5-9510-7101bcc61ee2 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:04.112705 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-0deeab54-1973-409d-9ed0-a7df5afcdfea req-c2f4c6e5-22b1-43d5-9510-7101bcc61ee2 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:04.124069 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-0deeab54-1973-409d-9ed0-a7df5afcdfea req-c2f4c6e5-22b1-43d5-9510-7101bcc61ee2 service nova] Creating event network-vif-deleted:229f7341-6966-4b67-9657-ed92a6db27a4 for instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 on hv-cinder-85220 Sep 01 16:43:04.129101 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-0deeab54-1973-409d-9ed0-a7df5afcdfea req-c2f4c6e5-22b1-43d5-9510-7101bcc61ee2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032627 Sep 01 16:43:04.130607 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 509/1049] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:43:04.653265 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-177f41a1-386c-48b6-af35-22c4abbe73fc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:04.653805 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-177f41a1-386c-48b6-af35-22c4abbe73fc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:04.661476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-177f41a1-386c-48b6-af35-22c4abbe73fc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:04.661953 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-177f41a1-386c-48b6-af35-22c4abbe73fc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:04.662414 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-177f41a1-386c-48b6-af35-22c4abbe73fc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:04.663098 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-177f41a1-386c-48b6-af35-22c4abbe73fc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:04.663544 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-177f41a1-386c-48b6-af35-22c4abbe73fc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:04.663961 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-177f41a1-386c-48b6-af35-22c4abbe73fc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:04.697250 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-177f41a1-386c-48b6-af35-22c4abbe73fc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:04.697725 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-177f41a1-386c-48b6-af35-22c4abbe73fc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:04.698154 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-177f41a1-386c-48b6-af35-22c4abbe73fc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:04.698695 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-177f41a1-386c-48b6-af35-22c4abbe73fc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lazy-loading 'fault' on Instance uuid 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:43:04.738779 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-177f41a1-386c-48b6-af35-22c4abbe73fc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003d7b8eee13419780bb5e055a01bb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ab20a85384485e95e2c0dadcc8b43c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:04.747153 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-177f41a1-386c-48b6-af35-22c4abbe73fc tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 200 len: 1348 microversion: 2.1 time: 0.097843 Sep 01 16:43:04.747983 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 541/1050] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:04 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:05.769657 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-00381a23-66c3-4e0f-b098-9bc9c1e5051d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:05.770987 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-00381a23-66c3-4e0f-b098-9bc9c1e5051d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] [instance: 840b3e8c-3b9a-44ee-8f03-43d332ca8b26] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:05.777035 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-00381a23-66c3-4e0f-b098-9bc9c1e5051d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:05.777514 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-00381a23-66c3-4e0f-b098-9bc9c1e5051d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:05.777938 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-00381a23-66c3-4e0f-b098-9bc9c1e5051d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:05.778645 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-00381a23-66c3-4e0f-b098-9bc9c1e5051d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:05.779092 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-00381a23-66c3-4e0f-b098-9bc9c1e5051d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:05.779510 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-00381a23-66c3-4e0f-b098-9bc9c1e5051d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:05.792446 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-00381a23-66c3-4e0f-b098-9bc9c1e5051d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] HTTP exception thrown: Instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 could not be found. Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-00381a23-66c3-4e0f-b098-9bc9c1e5051d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Request method failure captured: Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 HTTP/1.1 Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEOCMZmgmEYQpypp-6El2_UlfM7l1MH0iMcQPEqTtoBl07J2TPH0Zb99r_DsYOVR4yCPbpOZR8xTPpFhppG4OKbO41VU6gcXj7AWt_TSWJRga8ZPi9MhCNe-EmroQZEJQfT5Bj-Vc9QaO-LrOY7q-z4anhJPQF3XTf1gKp2_3Uhj8pmw Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: 13ab20a85384485e95e2c0dadcc8b43c Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-TestMinimumBasicScenario-1697085018 Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:43:05.794030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:43:05.795719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/13ab20a85384485e95e2c0dadcc8b43c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_13ab20a85384485e95e2c0dadcc8b43c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/13ab20a85384485e95e2c0dadcc8b43c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/13ab20a85384485e95e2c0dadcc8b43c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:43:05.795719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-TestMinimumBasicScenario-1697085018 Sep 01 16:43:05.795719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: 13ab20a85384485e95e2c0dadcc8b43c Sep 01 16:43:05.795719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1697085018 Sep 01 16:43:05.795719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-TestMinimumBasicScenario-1697085018-project Sep 01 16:43:05.795719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:43:05.795719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:43:05.795719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: 003d7b8eee13419780bb5e055a01bb77 Sep 01 16:43:05.795719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-TestMinimumBasicScenario-1697085018-project Sep 01 16:43:05.795719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:43:05.795719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 could not be found. Sep 01 16:43:05.795719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': '840b3e8c-3b9a-44ee-8f03-43d332ca8b26'} Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 could not be found. Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:43:05.796752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 could not be found. Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 could not be found. Sep 01 16:43:05.798480 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:43:05.800006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-00381a23-66c3-4e0f-b098-9bc9c1e5051d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Returning 404 to user: Instance 840b3e8c-3b9a-44ee-8f03-43d332ca8b26 could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:43:05.800006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-00381a23-66c3-4e0f-b098-9bc9c1e5051d tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26" status: 404 len: 111 microversion: 2.1 time: 0.030497 Sep 01 16:43:05.800006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 510/1051] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:05 2022] GET /compute/v2.1/servers/840b3e8c-3b9a-44ee-8f03-43d332ca8b26 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:43:05.804209 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-00361a02-1352-49b5-9e60-c56ab1dd46fa tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] Calling method '.version_select at 0x7feeec2b8c10>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:05.823221 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-00361a02-1352-49b5-9e60-c56ab1dd46fa tempest-TestMinimumBasicScenario-1697085018 tempest-TestMinimumBasicScenario-1697085018-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1922573567" status: 202 len: 0 microversion: 2.1 time: 0.022993 Sep 01 16:43:05.823781 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 542/1052] 10.222.0.18 () {58 vars in 1272 bytes} [Thu Sep 1 16:43:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1922573567 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:43:37.853798 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-607f4e7d-4576-4a1f-b515-ccb991c0f3af tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:37.854418 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-607f4e7d-4576-4a1f-b515-ccb991c0f3af tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:37.856509 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:37.857152 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=21 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:37.863856 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-607f4e7d-4576-4a1f-b515-ccb991c0f3af tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:37.864992 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-607f4e7d-4576-4a1f-b515-ccb991c0f3af tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:37.865429 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-607f4e7d-4576-4a1f-b515-ccb991c0f3af tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:37.866125 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-607f4e7d-4576-4a1f-b515-ccb991c0f3af tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:37.866620 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-607f4e7d-4576-4a1f-b515-ccb991c0f3af tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:37.867043 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-607f4e7d-4576-4a1f-b515-ccb991c0f3af tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:37.891041 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-607f4e7d-4576-4a1f-b515-ccb991c0f3af tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d/ips" status: 200 len: 150 microversion: 2.1 time: 0.041324 Sep 01 16:43:37.891607 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 511/1053] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 1 16:43:37 2022] GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:37.901338 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=9 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:37.902071 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:37.906905 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a713090d-9955-4baa-bccf-d0f7e3df981c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b37cbbf-b59d-4205-a7fa-5c86f0e30980"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:37.909733 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a713090d-9955-4baa-bccf-d0f7e3df981c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:37.916946 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a713090d-9955-4baa-bccf-d0f7e3df981c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:37.917689 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a713090d-9955-4baa-bccf-d0f7e3df981c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:37.918120 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a713090d-9955-4baa-bccf-d0f7e3df981c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:37.918839 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a713090d-9955-4baa-bccf-d0f7e3df981c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:37.919290 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a713090d-9955-4baa-bccf-d0f7e3df981c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:37.919709 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a713090d-9955-4baa-bccf-d0f7e3df981c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:37.999244 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-a713090d-9955-4baa-bccf-d0f7e3df981c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] HTTP exception thrown: Invalid volume: volume 6b37cbbf-b59d-4205-a7fa-5c86f0e30980 is already attached to instances: 870a289a-9e2c-4471-ac02-f9aa77461aff Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a713090d-9955-4baa-bccf-d0f7e3df981c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Request method failure captured: Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: POST /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d/os-volume_attachments HTTP/1.1 Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 74 Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEODFnwPNfevD_s2iqgjrJrwl5tsyQLcUPwsFoLuOLaCBQxUF3Innp8Fna8O4TdSVd9vYWEGFlMlL0SYz-lEDdpM7EPUs1IhWx7AcC2L6kveO3EqsUOvxYoQnZ0Lnpw-Lp1qby82G6PYCqAS-tNEfIiz9X92KchUl7n5MX3Dah7x9N0Y Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:43:38.000842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:43:38.002729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:43:38.002729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:43:38.002729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:43:38.002729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:43:38.002729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:43:38.002729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:43:38.002729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:43:38.002729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: a237b400429f4200909581e3c5e0cbfb Sep 01 16:43:38.002729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:43:38.002729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Sep 01 16:43:38.002729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {"volumeAttachment": {"volumeId": "6b37cbbf-b59d-4205-a7fa-5c86f0e30980"}} Sep 01 16:43:38.002729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Invalid volume: volume 6b37cbbf-b59d-4205-a7fa-5c86f0e30980 is already attached to instances: 870a289a-9e2c-4471-ac02-f9aa77461aff Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'server_id': 'd3520487-5780-44b3-9e04-28492a42939d', 'body': {'volumeAttachment': {'volumeId': '6b37cbbf-b59d-4205-a7fa-5c86f0e30980'}}} Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6b37cbbf-b59d-4205-a7fa-5c86f0e30980 is already attached to instances: 870a289a-9e2c-4471-ac02-f9aa77461aff Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:43:38.003871 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6b37cbbf-b59d-4205-a7fa-5c86f0e30980 is already attached to instances: 870a289a-9e2c-4471-ac02-f9aa77461aff Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:38.005681 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:38.007363 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:38.007363 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:43:38.007363 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:43:38.007363 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6b37cbbf-b59d-4205-a7fa-5c86f0e30980 is already attached to instances: 870a289a-9e2c-4471-ac02-f9aa77461aff Sep 01 16:43:38.007363 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:43:38.007363 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a713090d-9955-4baa-bccf-d0f7e3df981c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Returning 400 to user: Invalid volume: volume 6b37cbbf-b59d-4205-a7fa-5c86f0e30980 is already attached to instances: 870a289a-9e2c-4471-ac02-f9aa77461aff {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:43:38.007363 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a713090d-9955-4baa-bccf-d0f7e3df981c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "POST /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102884 Sep 01 16:43:38.007363 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 543/1054] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 1 16:43:37 2022] POST /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:43:38.011604 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a20dddd0-1b17-467e-a587-91bf8950df99 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:38.012128 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a20dddd0-1b17-467e-a587-91bf8950df99 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:38.018071 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a20dddd0-1b17-467e-a587-91bf8950df99 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:38.018585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a20dddd0-1b17-467e-a587-91bf8950df99 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:38.019018 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a20dddd0-1b17-467e-a587-91bf8950df99 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:38.019701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a20dddd0-1b17-467e-a587-91bf8950df99 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:38.020154 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a20dddd0-1b17-467e-a587-91bf8950df99 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:38.020613 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a20dddd0-1b17-467e-a587-91bf8950df99 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:38.044655 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a20dddd0-1b17-467e-a587-91bf8950df99 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Going to try to terminate instance {{(pid=127178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:43:38.122263 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a20dddd0-1b17-467e-a587-91bf8950df99 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d" status: 204 len: 0 microversion: 2.1 time: 0.113946 Sep 01 16:43:38.123452 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 512/1055] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:43:38 2022] DELETE /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:43:38.134187 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4093d345-d4b1-40dd-826d-c376e4ca38f4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:38.134956 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4093d345-d4b1-40dd-826d-c376e4ca38f4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:38.142533 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4093d345-d4b1-40dd-826d-c376e4ca38f4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:38.143123 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4093d345-d4b1-40dd-826d-c376e4ca38f4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:38.143606 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4093d345-d4b1-40dd-826d-c376e4ca38f4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:38.144390 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4093d345-d4b1-40dd-826d-c376e4ca38f4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:38.144952 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4093d345-d4b1-40dd-826d-c376e4ca38f4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:38.145373 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4093d345-d4b1-40dd-826d-c376e4ca38f4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:38.272472 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4093d345-d4b1-40dd-826d-c376e4ca38f4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:38.280149 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4093d345-d4b1-40dd-826d-c376e4ca38f4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d" status: 200 len: 1681 microversion: 2.1 time: 0.151119 Sep 01 16:43:38.280704 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 544/1056] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:38 2022] GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:43:39.303125 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b1b1f53c-dae4-4a57-b4c5-92102c813a87 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:39.303830 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b1b1f53c-dae4-4a57-b4c5-92102c813a87 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:39.310306 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1b1f53c-dae4-4a57-b4c5-92102c813a87 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:39.310789 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1b1f53c-dae4-4a57-b4c5-92102c813a87 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:39.311233 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1b1f53c-dae4-4a57-b4c5-92102c813a87 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:39.311925 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1b1f53c-dae4-4a57-b4c5-92102c813a87 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:39.312377 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1b1f53c-dae4-4a57-b4c5-92102c813a87 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:39.312803 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b1b1f53c-dae4-4a57-b4c5-92102c813a87 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:39.442103 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b1b1f53c-dae4-4a57-b4c5-92102c813a87 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:39.450745 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b1b1f53c-dae4-4a57-b4c5-92102c813a87 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d" status: 200 len: 1681 microversion: 2.1 time: 0.152318 Sep 01 16:43:39.451304 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 513/1057] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:39 2022] GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:40.473317 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cacb9b3d-4e9a-4ca8-8076-d4048e71e50d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:40.473905 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cacb9b3d-4e9a-4ca8-8076-d4048e71e50d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:40.480724 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cacb9b3d-4e9a-4ca8-8076-d4048e71e50d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:40.481215 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cacb9b3d-4e9a-4ca8-8076-d4048e71e50d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:40.481648 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cacb9b3d-4e9a-4ca8-8076-d4048e71e50d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:40.482394 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cacb9b3d-4e9a-4ca8-8076-d4048e71e50d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:40.482849 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cacb9b3d-4e9a-4ca8-8076-d4048e71e50d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:40.483272 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cacb9b3d-4e9a-4ca8-8076-d4048e71e50d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:40.555942 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cacb9b3d-4e9a-4ca8-8076-d4048e71e50d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:40.564852 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cacb9b3d-4e9a-4ca8-8076-d4048e71e50d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d" status: 200 len: 1614 microversion: 2.1 time: 0.095677 Sep 01 16:43:40.565450 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 545/1058] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:40 2022] GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d => generated 1614 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:40.906154 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-c35862c0-c31d-4024-89e1-9d3fc4271a9c req-5e2a70ba-237f-4f48-9ab4-f778c7a139a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3520487-5780-44b3-9e04-28492a42939d", "name": "network-vif-deleted", "tag": "4b66e1df-e040-432a-9d26-fef8d6c98bcf"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:40.918868 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-c35862c0-c31d-4024-89e1-9d3fc4271a9c req-5e2a70ba-237f-4f48-9ab4-f778c7a139a7 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:40.919478 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-c35862c0-c31d-4024-89e1-9d3fc4271a9c req-5e2a70ba-237f-4f48-9ab4-f778c7a139a7 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:40.919981 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-c35862c0-c31d-4024-89e1-9d3fc4271a9c req-5e2a70ba-237f-4f48-9ab4-f778c7a139a7 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:40.945517 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-c35862c0-c31d-4024-89e1-9d3fc4271a9c req-5e2a70ba-237f-4f48-9ab4-f778c7a139a7 service nova] Creating event network-vif-deleted:4b66e1df-e040-432a-9d26-fef8d6c98bcf for instance d3520487-5780-44b3-9e04-28492a42939d on hv-cinder-85220 Sep 01 16:43:40.950434 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-c35862c0-c31d-4024-89e1-9d3fc4271a9c req-5e2a70ba-237f-4f48-9ab4-f778c7a139a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047904 Sep 01 16:43:40.951022 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 514/1059] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:41.589021 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-72b23e38-8544-499d-860b-dc5a9a933e70 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:41.589637 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-72b23e38-8544-499d-860b-dc5a9a933e70 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:41.596439 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72b23e38-8544-499d-860b-dc5a9a933e70 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:41.596914 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72b23e38-8544-499d-860b-dc5a9a933e70 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:41.597283 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72b23e38-8544-499d-860b-dc5a9a933e70 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:41.598252 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72b23e38-8544-499d-860b-dc5a9a933e70 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:41.599347 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72b23e38-8544-499d-860b-dc5a9a933e70 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:41.599769 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72b23e38-8544-499d-860b-dc5a9a933e70 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:41.619858 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-72b23e38-8544-499d-860b-dc5a9a933e70 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] HTTP exception thrown: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-72b23e38-8544-499d-860b-dc5a9a933e70 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Request method failure captured: Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d HTTP/1.1 Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEODFnwPNfevD_s2iqgjrJrwl5tsyQLcUPwsFoLuOLaCBQxUF3Innp8Fna8O4TdSVd9vYWEGFlMlL0SYz-lEDdpM7EPUs1IhWx7AcC2L6kveO3EqsUOvxYoQnZ0Lnpw-Lp1qby82G6PYCqAS-tNEfIiz9X92KchUl7n5MX3Dah7x9N0Y Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:43:41.621522 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:43:41.623167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:43:41.623167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:43:41.623167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:43:41.623167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:43:41.623167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:43:41.623167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:43:41.623167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:43:41.623167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: a237b400429f4200909581e3c5e0cbfb Sep 01 16:43:41.623167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:43:41.623167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:43:41.623167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. Sep 01 16:43:41.623167 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': 'd3520487-5780-44b3-9e04-28492a42939d'} Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:43:41.624037 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. Sep 01 16:43:41.625362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:43:41.626512 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-72b23e38-8544-499d-860b-dc5a9a933e70 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Returning 404 to user: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:43:41.626512 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-72b23e38-8544-499d-860b-dc5a9a933e70 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d" status: 404 len: 111 microversion: 2.1 time: 0.038398 Sep 01 16:43:41.626512 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 546/1060] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:41 2022] GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:43:41.632666 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-00f28244-a10d-482b-87be-d72b1e4aa552 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '.version_select at 0x7feeec0ec790>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:41.652336 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-00f28244-a10d-482b-87be-d72b1e4aa552 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127395187" status: 202 len: 0 microversion: 2.1 time: 0.023817 Sep 01 16:43:41.653073 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 515/1061] 10.222.0.18 () {58 vars in 1221 bytes} [Thu Sep 1 16:43:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127395187 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:43:42.332271 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f79ef32f-747a-4756-8863-cc68ddcad6be tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:42.332799 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f79ef32f-747a-4756-8863-cc68ddcad6be tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:42.339397 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f79ef32f-747a-4756-8863-cc68ddcad6be tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:42.339885 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f79ef32f-747a-4756-8863-cc68ddcad6be tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:42.340325 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f79ef32f-747a-4756-8863-cc68ddcad6be tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:42.341014 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f79ef32f-747a-4756-8863-cc68ddcad6be tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:42.341465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f79ef32f-747a-4756-8863-cc68ddcad6be tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:42.341886 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f79ef32f-747a-4756-8863-cc68ddcad6be tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:42.420807 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-f79ef32f-747a-4756-8863-cc68ddcad6be tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lazy-loading 'services' on Instance uuid 870a289a-9e2c-4471-ac02-f9aa77461aff {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:43:42.492290 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f79ef32f-747a-4756-8863-cc68ddcad6be tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "DELETE /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff/os-volume_attachments/6b37cbbf-b59d-4205-a7fa-5c86f0e30980" status: 202 len: 0 microversion: 2.1 time: 0.163759 Sep 01 16:43:42.492884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 547/1062] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 1 16:43:42 2022] DELETE /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff/os-volume_attachments/6b37cbbf-b59d-4205-a7fa-5c86f0e30980 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:43:42.501881 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-61f54f39-7a52-4e33-bba8-84f73146ff13 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:42.504174 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-61f54f39-7a52-4e33-bba8-84f73146ff13 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:42.511782 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-61f54f39-7a52-4e33-bba8-84f73146ff13 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:42.512263 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-61f54f39-7a52-4e33-bba8-84f73146ff13 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:42.512696 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-61f54f39-7a52-4e33-bba8-84f73146ff13 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:42.513383 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-61f54f39-7a52-4e33-bba8-84f73146ff13 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:42.513825 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-61f54f39-7a52-4e33-bba8-84f73146ff13 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:42.514259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-61f54f39-7a52-4e33-bba8-84f73146ff13 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:42.546008 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-61f54f39-7a52-4e33-bba8-84f73146ff13 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048507 Sep 01 16:43:42.546600 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 516/1063] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:43:42 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:43.560087 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2a6ae1c9-5841-4b26-ad07-be0068ab66fa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:43.563444 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2a6ae1c9-5841-4b26-ad07-be0068ab66fa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:43.570449 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2a6ae1c9-5841-4b26-ad07-be0068ab66fa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:43.570931 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2a6ae1c9-5841-4b26-ad07-be0068ab66fa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:43.571363 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2a6ae1c9-5841-4b26-ad07-be0068ab66fa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:43.572065 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2a6ae1c9-5841-4b26-ad07-be0068ab66fa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:43.572518 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2a6ae1c9-5841-4b26-ad07-be0068ab66fa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:43.572938 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2a6ae1c9-5841-4b26-ad07-be0068ab66fa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:43.603374 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2a6ae1c9-5841-4b26-ad07-be0068ab66fa tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048099 Sep 01 16:43:43.603955 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 548/1064] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:43:43 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:43:43.664863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-c72ff1e0-71aa-4b43-8522-410b3a43cadc tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:43.665466 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c72ff1e0-71aa-4b43-8522-410b3a43cadc tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:43.671871 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c72ff1e0-71aa-4b43-8522-410b3a43cadc tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:43.672351 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c72ff1e0-71aa-4b43-8522-410b3a43cadc tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:43.672784 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c72ff1e0-71aa-4b43-8522-410b3a43cadc tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:43.673479 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c72ff1e0-71aa-4b43-8522-410b3a43cadc tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:43.673928 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c72ff1e0-71aa-4b43-8522-410b3a43cadc tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:43.674382 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-c72ff1e0-71aa-4b43-8522-410b3a43cadc tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:43.701155 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-c72ff1e0-71aa-4b43-8522-410b3a43cadc tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Going to try to terminate instance {{(pid=127178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:43:43.777073 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-c72ff1e0-71aa-4b43-8522-410b3a43cadc tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "DELETE /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff" status: 204 len: 0 microversion: 2.1 time: 0.116005 Sep 01 16:43:43.777903 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 517/1065] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:43:43 2022] DELETE /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:43:43.787569 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-728e4b8d-77ca-4fbc-b9d7-8c04c50945cd tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:43.788171 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-728e4b8d-77ca-4fbc-b9d7-8c04c50945cd tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:43.793993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-728e4b8d-77ca-4fbc-b9d7-8c04c50945cd tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:43.794496 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-728e4b8d-77ca-4fbc-b9d7-8c04c50945cd tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:43.794917 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-728e4b8d-77ca-4fbc-b9d7-8c04c50945cd tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:43.795585 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-728e4b8d-77ca-4fbc-b9d7-8c04c50945cd tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:43.796027 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-728e4b8d-77ca-4fbc-b9d7-8c04c50945cd tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:43.796438 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-728e4b8d-77ca-4fbc-b9d7-8c04c50945cd tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:43.928768 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-728e4b8d-77ca-4fbc-b9d7-8c04c50945cd tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:43.937100 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-728e4b8d-77ca-4fbc-b9d7-8c04c50945cd tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff" status: 200 len: 1683 microversion: 2.1 time: 0.153851 Sep 01 16:43:43.937834 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 549/1066] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:43 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:44.959559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-3c3dc3f0-f20f-40a8-9e63-3eb0c21988c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:44.960247 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-3c3dc3f0-f20f-40a8-9e63-3eb0c21988c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:44.971899 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3c3dc3f0-f20f-40a8-9e63-3eb0c21988c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:44.972385 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3c3dc3f0-f20f-40a8-9e63-3eb0c21988c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:44.973081 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3c3dc3f0-f20f-40a8-9e63-3eb0c21988c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:44.974468 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3c3dc3f0-f20f-40a8-9e63-3eb0c21988c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:44.974913 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3c3dc3f0-f20f-40a8-9e63-3eb0c21988c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:44.975328 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3c3dc3f0-f20f-40a8-9e63-3eb0c21988c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:45.109236 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-3c3dc3f0-f20f-40a8-9e63-3eb0c21988c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:45.117716 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-3c3dc3f0-f20f-40a8-9e63-3eb0c21988c0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff" status: 200 len: 1683 microversion: 2.1 time: 0.162954 Sep 01 16:43:45.118286 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 518/1067] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:44 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:46.138500 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-821e262e-3e5e-40e5-84a7-927cd82d6719 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:46.139109 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-821e262e-3e5e-40e5-84a7-927cd82d6719 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:46.145488 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-821e262e-3e5e-40e5-84a7-927cd82d6719 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:46.145954 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-821e262e-3e5e-40e5-84a7-927cd82d6719 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:46.146424 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-821e262e-3e5e-40e5-84a7-927cd82d6719 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:46.147101 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-821e262e-3e5e-40e5-84a7-927cd82d6719 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:46.147537 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-821e262e-3e5e-40e5-84a7-927cd82d6719 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:46.147946 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-821e262e-3e5e-40e5-84a7-927cd82d6719 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:46.212709 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-821e262e-3e5e-40e5-84a7-927cd82d6719 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:46.221397 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-821e262e-3e5e-40e5-84a7-927cd82d6719 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff" status: 200 len: 1615 microversion: 2.1 time: 0.086666 Sep 01 16:43:46.221989 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 550/1068] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:46 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff => generated 1615 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:46.231442 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-0a918236-d217-41d0-a0f5-3217b045c094 req-418724ce-6558-4cfb-a77b-f5e7f324ed6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "870a289a-9e2c-4471-ac02-f9aa77461aff", "name": "network-vif-deleted", "tag": "75ac0e1d-9e18-472b-a40c-6d01c150b883"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:46.241725 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-0a918236-d217-41d0-a0f5-3217b045c094 req-418724ce-6558-4cfb-a77b-f5e7f324ed6d service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:46.242579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-0a918236-d217-41d0-a0f5-3217b045c094 req-418724ce-6558-4cfb-a77b-f5e7f324ed6d service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:46.243134 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-0a918236-d217-41d0-a0f5-3217b045c094 req-418724ce-6558-4cfb-a77b-f5e7f324ed6d service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:46.255094 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-0a918236-d217-41d0-a0f5-3217b045c094 req-418724ce-6558-4cfb-a77b-f5e7f324ed6d service nova] Creating event network-vif-deleted:75ac0e1d-9e18-472b-a40c-6d01c150b883 for instance 870a289a-9e2c-4471-ac02-f9aa77461aff on hv-cinder-85220 Sep 01 16:43:46.260101 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-0a918236-d217-41d0-a0f5-3217b045c094 req-418724ce-6558-4cfb-a77b-f5e7f324ed6d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032346 Sep 01 16:43:46.261517 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 519/1069] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:47.243477 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-25af1b82-a01f-4ca3-b10e-746675b94c57 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:47.244093 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-25af1b82-a01f-4ca3-b10e-746675b94c57 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:47.250821 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25af1b82-a01f-4ca3-b10e-746675b94c57 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:47.251627 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25af1b82-a01f-4ca3-b10e-746675b94c57 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:47.252256 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25af1b82-a01f-4ca3-b10e-746675b94c57 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:47.252984 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25af1b82-a01f-4ca3-b10e-746675b94c57 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:47.253441 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25af1b82-a01f-4ca3-b10e-746675b94c57 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:47.253859 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25af1b82-a01f-4ca3-b10e-746675b94c57 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:47.269680 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-25af1b82-a01f-4ca3-b10e-746675b94c57 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] HTTP exception thrown: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-25af1b82-a01f-4ca3-b10e-746675b94c57 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Request method failure captured: Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff HTTP/1.1 Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEODFnwPNfevD_s2iqgjrJrwl5tsyQLcUPwsFoLuOLaCBQxUF3Innp8Fna8O4TdSVd9vYWEGFlMlL0SYz-lEDdpM7EPUs1IhWx7AcC2L6kveO3EqsUOvxYoQnZ0Lnpw-Lp1qby82G6PYCqAS-tNEfIiz9X92KchUl7n5MX3Dah7x9N0Y Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:43:47.271862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:43:47.273518 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:43:47.273518 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:43:47.273518 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:43:47.273518 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:43:47.273518 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:43:47.273518 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:43:47.273518 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:43:47.273518 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: a237b400429f4200909581e3c5e0cbfb Sep 01 16:43:47.273518 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:43:47.273518 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:43:47.273518 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. Sep 01 16:43:47.273518 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': '870a289a-9e2c-4471-ac02-f9aa77461aff'} Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:43:47.274679 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. Sep 01 16:43:47.276220 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:43:47.277715 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-25af1b82-a01f-4ca3-b10e-746675b94c57 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Returning 404 to user: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:43:47.277715 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-25af1b82-a01f-4ca3-b10e-746675b94c57 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff" status: 404 len: 111 microversion: 2.1 time: 0.033775 Sep 01 16:43:47.277715 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 551/1070] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:47 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:43:47.283066 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-3a7da9c9-46e5-41cf-801e-a845b20ad2b8 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '.version_select at 0x7feeec128d30>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:47.305379 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-3a7da9c9-46e5-41cf-801e-a845b20ad2b8 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1097885945" status: 202 len: 0 microversion: 2.1 time: 0.026853 Sep 01 16:43:47.305979 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 520/1071] 10.222.0.18 () {58 vars in 1221 bytes} [Thu Sep 1 16:43:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1097885945 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:43:47.915122 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f052b074-9046-4414-b287-62413e9e07b2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Action: 'create', calling method: .version_select at 0x7feeec03e0d0>, body: {"keypair": {"name": "tempest-keypair-553599726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1nBeMClGs2Fx4sFTJSWN2GK4wI2RnK7X4Z+fDCn/xq3IQnICS9Zad86FSg3JxucefQW6FoE+y8/7P7+3UiQdhUSWhjpFfrvTVIf0sRYcoDMDILjPeE6VH1NyTW91Nt0A=="}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:47.930274 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-f052b074-9046-4414-b287-62413e9e07b2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Getting quotas for project 9b9aa20e1ffb453d9ee13dd6ae2c25ef. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:43:47.933996 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-f052b074-9046-4414-b287-62413e9e07b2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Getting quotas for user a237b400429f4200909581e3c5e0cbfb and project 9b9aa20e1ffb453d9ee13dd6ae2c25ef. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:43:47.955952 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f052b074-9046-4414-b287-62413e9e07b2 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045377 Sep 01 16:43:47.956533 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 552/1072] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 1 16:43:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:49.191523 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-403816229", "imageRef": "46185d58-0d47-4c97-b590-0f4434aa5c9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae0395ee-74d9-4949-89c6-cf6ebc736a46"}], "security_groups": [{"name": "tempest-securitygroup--1624848692"}], "key_name": "tempest-keypair-553599726", "user_data": "}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:49.296523 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.network.neutron [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] validate_networks() for [('ae0395ee-74d9-4949-89c6-cf6ebc736a46', None, None, None, None, None)] {{(pid=127178) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:43:49.664635 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Flavor limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:43:49.665061 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Image limits 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:43:49.665534 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Flavor pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:43:49.665944 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Image pref 0:0:0 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:43:49.666389 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.virt.hardware [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:43:49.675261 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:49.675771 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:49.676211 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:49.676937 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:49.677388 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:49.677812 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:49.694796 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Getting quotas for project 9b9aa20e1ffb453d9ee13dd6ae2c25ef. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:43:49.698745 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Getting quotas for user a237b400429f4200909581e3c5e0cbfb and project 9b9aa20e1ffb453d9ee13dd6ae2c25ef. Resources: {'instances', 'cores', 'ram'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:43:49.710104 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Going to run 1 instances... {{(pid=127178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:43:49.712485 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46185d58-0d47-4c97-b590-0f4434aa5c9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:43:49.761978 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-0fcf621d-9ed3-4a92-8599-ba6041abb671 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.575383 Sep 01 16:43:49.762585 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 521/1073] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:43:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:43:49.773892 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-313ce13a-4d6e-423c-ae94-c28fefaf119a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:49.774524 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-313ce13a-4d6e-423c-ae94-c28fefaf119a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:49.833079 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-313ce13a-4d6e-423c-ae94-c28fefaf119a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:49.840019 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-313ce13a-4d6e-423c-ae94-c28fefaf119a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791" status: 200 len: 1240 microversion: 2.1 time: 0.070607 Sep 01 16:43:49.840580 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 553/1074] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:49 2022] GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:50.862640 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-0610ed2f-e224-4f5a-a98e-baeaed164985 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:50.863340 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0610ed2f-e224-4f5a-a98e-baeaed164985 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:50.869789 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0610ed2f-e224-4f5a-a98e-baeaed164985 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:50.870285 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0610ed2f-e224-4f5a-a98e-baeaed164985 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:50.870719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0610ed2f-e224-4f5a-a98e-baeaed164985 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:50.871402 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0610ed2f-e224-4f5a-a98e-baeaed164985 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:50.871848 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0610ed2f-e224-4f5a-a98e-baeaed164985 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:50.872265 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0610ed2f-e224-4f5a-a98e-baeaed164985 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:50.957025 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0610ed2f-e224-4f5a-a98e-baeaed164985 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:50.965419 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-0610ed2f-e224-4f5a-a98e-baeaed164985 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791" status: 200 len: 1300 microversion: 2.1 time: 0.107443 Sep 01 16:43:50.966759 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 522/1075] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:50 2022] GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:43:51.987875 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a72c7f8d-9adf-402a-91ab-47965ebb4670 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:51.988476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a72c7f8d-9adf-402a-91ab-47965ebb4670 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:51.995801 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a72c7f8d-9adf-402a-91ab-47965ebb4670 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:51.996277 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a72c7f8d-9adf-402a-91ab-47965ebb4670 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:51.996705 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a72c7f8d-9adf-402a-91ab-47965ebb4670 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:51.997392 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a72c7f8d-9adf-402a-91ab-47965ebb4670 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:51.997832 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a72c7f8d-9adf-402a-91ab-47965ebb4670 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:51.998256 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a72c7f8d-9adf-402a-91ab-47965ebb4670 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:52.140856 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a72c7f8d-9adf-402a-91ab-47965ebb4670 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:52.149541 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a72c7f8d-9adf-402a-91ab-47965ebb4670 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791" status: 200 len: 1366 microversion: 2.1 time: 0.165719 Sep 01 16:43:52.150419 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 554/1076] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:51 2022] GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:52.273378 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-4af15f33-3e2a-40de-970d-3484bc0edbe5 req-39beec3e-5590-417c-99de-fabf5e1afbaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c11dd8bc-ee5b-47f8-b54b-d5486b441791", "tag": "5fa0b631-72cd-4970-bb22-e93cf21f9acc"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:52.285559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-4af15f33-3e2a-40de-970d-3484bc0edbe5 req-39beec3e-5590-417c-99de-fabf5e1afbaf service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:52.287348 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-4af15f33-3e2a-40de-970d-3484bc0edbe5 req-39beec3e-5590-417c-99de-fabf5e1afbaf service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:52.287811 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-4af15f33-3e2a-40de-970d-3484bc0edbe5 req-39beec3e-5590-417c-99de-fabf5e1afbaf service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:52.300607 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-4af15f33-3e2a-40de-970d-3484bc0edbe5 req-39beec3e-5590-417c-99de-fabf5e1afbaf service nova] Creating event network-changed:5fa0b631-72cd-4970-bb22-e93cf21f9acc for instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 on hv-cinder-85220 Sep 01 16:43:52.305953 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-4af15f33-3e2a-40de-970d-3484bc0edbe5 req-39beec3e-5590-417c-99de-fabf5e1afbaf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037896 Sep 01 16:43:52.306582 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 523/1077] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:43:53.170171 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-545435ab-42b6-49ff-ae27-78b8a3c6291e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:53.170796 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-545435ab-42b6-49ff-ae27-78b8a3c6291e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:53.177707 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-545435ab-42b6-49ff-ae27-78b8a3c6291e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:53.178181 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-545435ab-42b6-49ff-ae27-78b8a3c6291e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:53.178629 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-545435ab-42b6-49ff-ae27-78b8a3c6291e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:53.179306 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-545435ab-42b6-49ff-ae27-78b8a3c6291e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:53.179744 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-545435ab-42b6-49ff-ae27-78b8a3c6291e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:53.180155 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-545435ab-42b6-49ff-ae27-78b8a3c6291e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:53.310593 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-545435ab-42b6-49ff-ae27-78b8a3c6291e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:53.318709 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-545435ab-42b6-49ff-ae27-78b8a3c6291e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791" status: 200 len: 1366 microversion: 2.1 time: 0.152327 Sep 01 16:43:53.319270 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 555/1078] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:53 2022] GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:54.340199 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-ce17d46c-a2d1-4cf5-9d8c-2aa51d86ec8e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:54.340927 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-ce17d46c-a2d1-4cf5-9d8c-2aa51d86ec8e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:54.347914 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ce17d46c-a2d1-4cf5-9d8c-2aa51d86ec8e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:54.348391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ce17d46c-a2d1-4cf5-9d8c-2aa51d86ec8e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:54.348828 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ce17d46c-a2d1-4cf5-9d8c-2aa51d86ec8e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:54.349521 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ce17d46c-a2d1-4cf5-9d8c-2aa51d86ec8e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:54.349971 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ce17d46c-a2d1-4cf5-9d8c-2aa51d86ec8e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:54.350420 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-ce17d46c-a2d1-4cf5-9d8c-2aa51d86ec8e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:54.484218 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-ce17d46c-a2d1-4cf5-9d8c-2aa51d86ec8e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:54.493010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-ce17d46c-a2d1-4cf5-9d8c-2aa51d86ec8e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791" status: 200 len: 1366 microversion: 2.1 time: 0.156904 Sep 01 16:43:54.493603 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 524/1079] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:54 2022] GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:55.513608 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-25400774-d886-447e-88e2-44e61ad49c4c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:55.514216 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-25400774-d886-447e-88e2-44e61ad49c4c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:55.521204 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25400774-d886-447e-88e2-44e61ad49c4c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:55.521682 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25400774-d886-447e-88e2-44e61ad49c4c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:55.522114 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25400774-d886-447e-88e2-44e61ad49c4c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:55.522831 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25400774-d886-447e-88e2-44e61ad49c4c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:55.523279 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25400774-d886-447e-88e2-44e61ad49c4c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:55.523696 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25400774-d886-447e-88e2-44e61ad49c4c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:55.817597 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-0c788175-6eb3-4fc4-880d-313588d57f20 req-65705909-cb62-4ea0-aa0d-b350471b022e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c11dd8bc-ee5b-47f8-b54b-d5486b441791", "name": "network-vif-plugged", "status": "completed", "tag": "5fa0b631-72cd-4970-bb22-e93cf21f9acc"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:55.824036 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-25400774-d886-447e-88e2-44e61ad49c4c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:55.832616 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-0c788175-6eb3-4fc4-880d-313588d57f20 req-65705909-cb62-4ea0-aa0d-b350471b022e service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:55.833089 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-0c788175-6eb3-4fc4-880d-313588d57f20 req-65705909-cb62-4ea0-aa0d-b350471b022e service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:55.833284 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-25400774-d886-447e-88e2-44e61ad49c4c tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791" status: 200 len: 1366 microversion: 2.1 time: 0.323139 Sep 01 16:43:55.833517 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-0c788175-6eb3-4fc4-880d-313588d57f20 req-65705909-cb62-4ea0-aa0d-b350471b022e service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:55.834092 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 556/1080] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:55 2022] GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:55.855266 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-0c788175-6eb3-4fc4-880d-313588d57f20 req-65705909-cb62-4ea0-aa0d-b350471b022e service nova] Creating event network-vif-plugged:5fa0b631-72cd-4970-bb22-e93cf21f9acc for instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 on hv-cinder-85220 Sep 01 16:43:55.859415 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-0c788175-6eb3-4fc4-880d-313588d57f20 req-65705909-cb62-4ea0-aa0d-b350471b022e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051689 Sep 01 16:43:55.860018 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 525/1081] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:56.855110 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f1a276ad-92b5-41c8-a2a9-ec6c239fd059 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:56.855708 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f1a276ad-92b5-41c8-a2a9-ec6c239fd059 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:56.862206 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1a276ad-92b5-41c8-a2a9-ec6c239fd059 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:56.862713 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1a276ad-92b5-41c8-a2a9-ec6c239fd059 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:56.863143 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1a276ad-92b5-41c8-a2a9-ec6c239fd059 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:56.863830 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1a276ad-92b5-41c8-a2a9-ec6c239fd059 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:56.864284 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1a276ad-92b5-41c8-a2a9-ec6c239fd059 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:56.864698 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1a276ad-92b5-41c8-a2a9-ec6c239fd059 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:57.005578 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f1a276ad-92b5-41c8-a2a9-ec6c239fd059 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:57.013248 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f1a276ad-92b5-41c8-a2a9-ec6c239fd059 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791" status: 200 len: 1366 microversion: 2.1 time: 0.162023 Sep 01 16:43:57.013810 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 557/1082] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:56 2022] GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:43:58.035477 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a5f841a2-1826-4e6d-b54e-9dd9b14b420a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:58.036173 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a5f841a2-1826-4e6d-b54e-9dd9b14b420a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:58.042475 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a5f841a2-1826-4e6d-b54e-9dd9b14b420a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:58.042953 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a5f841a2-1826-4e6d-b54e-9dd9b14b420a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:58.043391 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a5f841a2-1826-4e6d-b54e-9dd9b14b420a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:58.044075 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a5f841a2-1826-4e6d-b54e-9dd9b14b420a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:58.044520 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a5f841a2-1826-4e6d-b54e-9dd9b14b420a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:58.044941 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a5f841a2-1826-4e6d-b54e-9dd9b14b420a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:58.237271 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a5f841a2-1826-4e6d-b54e-9dd9b14b420a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:58.245593 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a5f841a2-1826-4e6d-b54e-9dd9b14b420a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791" status: 200 len: 1556 microversion: 2.1 time: 0.214787 Sep 01 16:43:58.246140 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 526/1083] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:58 2022] GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 => generated 1556 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:58.266533 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e29975db-425f-43c8-82ae-4b48778ea997 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:58.267291 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e29975db-425f-43c8-82ae-4b48778ea997 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:58.273801 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e29975db-425f-43c8-82ae-4b48778ea997 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:58.274316 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e29975db-425f-43c8-82ae-4b48778ea997 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:58.274780 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e29975db-425f-43c8-82ae-4b48778ea997 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:58.275470 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e29975db-425f-43c8-82ae-4b48778ea997 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:58.275917 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e29975db-425f-43c8-82ae-4b48778ea997 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:58.276332 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e29975db-425f-43c8-82ae-4b48778ea997 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:58.357951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e29975db-425f-43c8-82ae-4b48778ea997 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095468 Sep 01 16:43:58.358573 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 558/1084] 10.222.0.18 () {58 vars in 1275 bytes} [Thu Sep 1 16:43:58 2022] GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:59.337127 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-a46382a2-2990-4d13-9468-621e326b31ed req-a0c68570-c3c5-487d-9ce4-f3fbc06c0898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c11dd8bc-ee5b-47f8-b54b-d5486b441791", "tag": "5fa0b631-72cd-4970-bb22-e93cf21f9acc"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:59.348244 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-a46382a2-2990-4d13-9468-621e326b31ed req-a0c68570-c3c5-487d-9ce4-f3fbc06c0898 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:59.348724 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-a46382a2-2990-4d13-9468-621e326b31ed req-a0c68570-c3c5-487d-9ce4-f3fbc06c0898 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:59.349148 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-a46382a2-2990-4d13-9468-621e326b31ed req-a0c68570-c3c5-487d-9ce4-f3fbc06c0898 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:59.361244 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-a46382a2-2990-4d13-9468-621e326b31ed req-a0c68570-c3c5-487d-9ce4-f3fbc06c0898 service nova] Creating event network-changed:5fa0b631-72cd-4970-bb22-e93cf21f9acc for instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 on hv-cinder-85220 Sep 01 16:43:59.367473 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-a46382a2-2990-4d13-9468-621e326b31ed req-a0c68570-c3c5-487d-9ce4-f3fbc06c0898 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034834 Sep 01 16:43:59.368713 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 527/1085] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:06.704498 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=6 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:06.710124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-42b4c726-a588-4680-ac16-11724843e99b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:06.710647 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-42b4c726-a588-4680-ac16-11724843e99b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:06.714559 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-a6efc08b-78b2-46b7-b995-bb3b95f577ab req-8fc0a1d4-d278-41e2-aecc-2a737ee2be7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05425634-c94f-4f95-a99b-ee2058fd092d", "tag": "246797ab-f380-41b3-b1f0-53ace837a15f"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:06.717017 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-42b4c726-a588-4680-ac16-11724843e99b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:06.717496 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-42b4c726-a588-4680-ac16-11724843e99b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:06.717921 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-42b4c726-a588-4680-ac16-11724843e99b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:06.718646 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-42b4c726-a588-4680-ac16-11724843e99b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:06.719096 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-42b4c726-a588-4680-ac16-11724843e99b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:06.719569 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-42b4c726-a588-4680-ac16-11724843e99b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:06.727235 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:06.728118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=6 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:06.734130 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-a6efc08b-78b2-46b7-b995-bb3b95f577ab req-8fc0a1d4-d278-41e2-aecc-2a737ee2be7b service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:06.734830 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-a6efc08b-78b2-46b7-b995-bb3b95f577ab req-8fc0a1d4-d278-41e2-aecc-2a737ee2be7b service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:06.735255 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-a6efc08b-78b2-46b7-b995-bb3b95f577ab req-8fc0a1d4-d278-41e2-aecc-2a737ee2be7b service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:06.747296 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-a6efc08b-78b2-46b7-b995-bb3b95f577ab req-8fc0a1d4-d278-41e2-aecc-2a737ee2be7b service nova] Creating event network-changed:246797ab-f380-41b3-b1f0-53ace837a15f for instance 05425634-c94f-4f95-a99b-ee2058fd092d on hv-cinder-85220 Sep 01 16:44:06.747523 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-42b4c726-a588-4680-ac16-11724843e99b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:44:06.752326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-a6efc08b-78b2-46b7-b995-bb3b95f577ab req-8fc0a1d4-d278-41e2-aecc-2a737ee2be7b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046233 Sep 01 16:44:06.753293 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 528/1086] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:06.830556 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-42b4c726-a588-4680-ac16-11724843e99b tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 204 len: 0 microversion: 2.1 time: 0.126932 Sep 01 16:44:06.834996 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 559/1087] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:44:06 2022] DELETE /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:44:06.840866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-8cc0aee4-667a-4a74-8b7e-a002dabe90a0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:06.841888 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-8cc0aee4-667a-4a74-8b7e-a002dabe90a0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:06.849107 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8cc0aee4-667a-4a74-8b7e-a002dabe90a0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:06.849779 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8cc0aee4-667a-4a74-8b7e-a002dabe90a0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:06.850586 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8cc0aee4-667a-4a74-8b7e-a002dabe90a0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:06.851684 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8cc0aee4-667a-4a74-8b7e-a002dabe90a0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:06.852245 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8cc0aee4-667a-4a74-8b7e-a002dabe90a0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:06.852772 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8cc0aee4-667a-4a74-8b7e-a002dabe90a0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:06.999841 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-8cc0aee4-667a-4a74-8b7e-a002dabe90a0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:07.010353 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-8cc0aee4-667a-4a74-8b7e-a002dabe90a0 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1577 microversion: 2.1 time: 0.173603 Sep 01 16:44:07.011549 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 529/1088] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:06 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:44:08.033809 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-adfb57d5-8a1d-4e7e-b5fb-c2d3772ef3bb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:08.034547 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-adfb57d5-8a1d-4e7e-b5fb-c2d3772ef3bb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:08.037108 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:08.043117 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adfb57d5-8a1d-4e7e-b5fb-c2d3772ef3bb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:08.043631 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adfb57d5-8a1d-4e7e-b5fb-c2d3772ef3bb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:08.044060 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adfb57d5-8a1d-4e7e-b5fb-c2d3772ef3bb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:08.044750 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adfb57d5-8a1d-4e7e-b5fb-c2d3772ef3bb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:08.045193 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adfb57d5-8a1d-4e7e-b5fb-c2d3772ef3bb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:08.045605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adfb57d5-8a1d-4e7e-b5fb-c2d3772ef3bb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:08.050263 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:08.183375 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-adfb57d5-8a1d-4e7e-b5fb-c2d3772ef3bb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:08.191998 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-adfb57d5-8a1d-4e7e-b5fb-c2d3772ef3bb tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1577 microversion: 2.1 time: 0.162694 Sep 01 16:44:08.192642 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 560/1089] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:08 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:44:09.213742 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7c469363-60b4-43bf-86de-a1246be93b8f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:09.214555 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7c469363-60b4-43bf-86de-a1246be93b8f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:09.216878 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:09.223592 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c469363-60b4-43bf-86de-a1246be93b8f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:09.224137 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c469363-60b4-43bf-86de-a1246be93b8f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:09.224602 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c469363-60b4-43bf-86de-a1246be93b8f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:09.225345 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c469363-60b4-43bf-86de-a1246be93b8f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:09.225803 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c469363-60b4-43bf-86de-a1246be93b8f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:09.226228 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7c469363-60b4-43bf-86de-a1246be93b8f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:09.229939 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:09.249203 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-a8aa3d84-4e8b-458d-8112-c4f7f55d04c6 req-bbc5d8ad-8ee5-42a9-ba87-04a1a7b586a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05425634-c94f-4f95-a99b-ee2058fd092d", "name": "network-vif-deleted", "tag": "246797ab-f380-41b3-b1f0-53ace837a15f"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:09.260657 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-a8aa3d84-4e8b-458d-8112-c4f7f55d04c6 req-bbc5d8ad-8ee5-42a9-ba87-04a1a7b586a4 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:09.261187 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-a8aa3d84-4e8b-458d-8112-c4f7f55d04c6 req-bbc5d8ad-8ee5-42a9-ba87-04a1a7b586a4 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:09.261643 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-a8aa3d84-4e8b-458d-8112-c4f7f55d04c6 req-bbc5d8ad-8ee5-42a9-ba87-04a1a7b586a4 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:09.274866 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-a8aa3d84-4e8b-458d-8112-c4f7f55d04c6 req-bbc5d8ad-8ee5-42a9-ba87-04a1a7b586a4 service nova] Creating event network-vif-deleted:246797ab-f380-41b3-b1f0-53ace837a15f for instance 05425634-c94f-4f95-a99b-ee2058fd092d on hv-cinder-85220 Sep 01 16:44:09.280852 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-a8aa3d84-4e8b-458d-8112-c4f7f55d04c6 req-bbc5d8ad-8ee5-42a9-ba87-04a1a7b586a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036018 Sep 01 16:44:09.281883 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 561/1090] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:44:09.309926 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-7c469363-60b4-43bf-86de-a1246be93b8f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:09.318848 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7c469363-60b4-43bf-86de-a1246be93b8f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 200 len: 1391 microversion: 2.1 time: 0.109311 Sep 01 16:44:09.319470 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 530/1091] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:09 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 1391 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:10.341799 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e387ffc7-3b8c-4664-b65b-034eda098f3f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:10.342526 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e387ffc7-3b8c-4664-b65b-034eda098f3f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: 05425634-c94f-4f95-a99b-ee2058fd092d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:10.349709 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e387ffc7-3b8c-4664-b65b-034eda098f3f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:10.350124 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e387ffc7-3b8c-4664-b65b-034eda098f3f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:10.350583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e387ffc7-3b8c-4664-b65b-034eda098f3f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:10.351271 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e387ffc7-3b8c-4664-b65b-034eda098f3f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:10.351713 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e387ffc7-3b8c-4664-b65b-034eda098f3f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:10.352139 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e387ffc7-3b8c-4664-b65b-034eda098f3f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:10.366890 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-e387ffc7-3b8c-4664-b65b-034eda098f3f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] HTTP exception thrown: Instance 05425634-c94f-4f95-a99b-ee2058fd092d could not be found. Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e387ffc7-3b8c-4664-b65b-034eda098f3f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Request method failure captured: Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d HTTP/1.1 Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN97HOKS9R-V8DgrBoRJO26WuPh_i2vM7On4Gl0HRk0g1m7yeMKkG5i083NgJ-nZpc0UQUxBDaiPb0hMA7EoGz6-TWv1RfzGfrvYBpMeN9gFsW_iVL61zLNeE3FauMkLRNWoLCx9Vl2WG6Q8cLIFRhdExCCMwWlX8XLFz3EoF1zKnBA Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 4b6bf55e6c5e47f3895e135c4d6dc3ff Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-TestVolumeBootPattern-1980304612 Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:44:10.368434 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:44:10.369957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:44:10.369957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-TestVolumeBootPattern-1980304612 Sep 01 16:44:10.369957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 4b6bf55e6c5e47f3895e135c4d6dc3ff Sep 01 16:44:10.369957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-TestVolumeBootPattern-1980304612 Sep 01 16:44:10.369957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-TestVolumeBootPattern-1980304612-project Sep 01 16:44:10.369957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:44:10.369957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:44:10.369957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: a3059f5115bb4bad837daf9f18752143 Sep 01 16:44:10.369957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-TestVolumeBootPattern-1980304612-project Sep 01 16:44:10.369957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:44:10.369957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance 05425634-c94f-4f95-a99b-ee2058fd092d could not be found. Sep 01 16:44:10.369957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': '05425634-c94f-4f95-a99b-ee2058fd092d'} Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05425634-c94f-4f95-a99b-ee2058fd092d could not be found. Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:44:10.371052 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05425634-c94f-4f95-a99b-ee2058fd092d could not be found. Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05425634-c94f-4f95-a99b-ee2058fd092d could not be found. Sep 01 16:44:10.372592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:10.373855 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e387ffc7-3b8c-4664-b65b-034eda098f3f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Returning 404 to user: Instance 05425634-c94f-4f95-a99b-ee2058fd092d could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:44:10.373855 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e387ffc7-3b8c-4664-b65b-034eda098f3f tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d" status: 404 len: 111 microversion: 2.1 time: 0.032892 Sep 01 16:44:10.373855 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 562/1092] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:10 2022] GET /compute/v2.1/servers/05425634-c94f-4f95-a99b-ee2058fd092d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:44:12.709972 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-460ea645-5909-47d8-bb4e-90186c9c0cd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:12.710550 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-460ea645-5909-47d8-bb4e-90186c9c0cd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:12.712632 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-388fb1ab-2948-4a5e-8412-2c4b530c3246 req-72f7822b-505e-42a6-b7c7-d8f9fc43715f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad0df24-0b95-4583-9017-6322bebd55a0", "tag": "85932ff9-5198-4161-a8d5-3f43070b4618"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:12.722984 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-460ea645-5909-47d8-bb4e-90186c9c0cd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:12.724071 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-460ea645-5909-47d8-bb4e-90186c9c0cd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:12.724199 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-388fb1ab-2948-4a5e-8412-2c4b530c3246 req-72f7822b-505e-42a6-b7c7-d8f9fc43715f service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:12.724729 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-388fb1ab-2948-4a5e-8412-2c4b530c3246 req-72f7822b-505e-42a6-b7c7-d8f9fc43715f service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:12.725067 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-460ea645-5909-47d8-bb4e-90186c9c0cd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:12.725545 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-388fb1ab-2948-4a5e-8412-2c4b530c3246 req-72f7822b-505e-42a6-b7c7-d8f9fc43715f service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:12.726254 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-460ea645-5909-47d8-bb4e-90186c9c0cd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:12.727020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-460ea645-5909-47d8-bb4e-90186c9c0cd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:12.727539 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-460ea645-5909-47d8-bb4e-90186c9c0cd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:12.741172 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-388fb1ab-2948-4a5e-8412-2c4b530c3246 req-72f7822b-505e-42a6-b7c7-d8f9fc43715f service nova] Creating event network-changed:85932ff9-5198-4161-a8d5-3f43070b4618 for instance fad0df24-0b95-4583-9017-6322bebd55a0 on hv-cinder-85220 Sep 01 16:44:12.747662 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-388fb1ab-2948-4a5e-8412-2c4b530c3246 req-72f7822b-505e-42a6-b7c7-d8f9fc43715f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039239 Sep 01 16:44:12.748910 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 563/1093] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:12.758214 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-460ea645-5909-47d8-bb4e-90186c9c0cd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Going to try to terminate instance {{(pid=127178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:44:12.853996 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-460ea645-5909-47d8-bb4e-90186c9c0cd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 204 len: 0 microversion: 2.1 time: 0.148196 Sep 01 16:44:12.854805 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 531/1094] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:44:12 2022] DELETE /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:44:12.867143 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ad19a501-30a5-4c9a-9b8c-b6c53e7195dd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:12.868657 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ad19a501-30a5-4c9a-9b8c-b6c53e7195dd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:12.879730 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad19a501-30a5-4c9a-9b8c-b6c53e7195dd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:12.880378 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad19a501-30a5-4c9a-9b8c-b6c53e7195dd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:12.881438 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad19a501-30a5-4c9a-9b8c-b6c53e7195dd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:12.882530 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad19a501-30a5-4c9a-9b8c-b6c53e7195dd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:12.883290 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad19a501-30a5-4c9a-9b8c-b6c53e7195dd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:12.883987 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad19a501-30a5-4c9a-9b8c-b6c53e7195dd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:13.036513 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ad19a501-30a5-4c9a-9b8c-b6c53e7195dd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:13.044346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ad19a501-30a5-4c9a-9b8c-b6c53e7195dd tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1566 microversion: 2.1 time: 0.183921 Sep 01 16:44:13.058029 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 564/1095] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:12 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1566 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:13.661652 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-436de7c6-84b6-4398-9f7b-336c6b578116 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:13.662399 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-436de7c6-84b6-4398-9f7b-336c6b578116 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:13.673813 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-436de7c6-84b6-4398-9f7b-336c6b578116 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:13.674447 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-436de7c6-84b6-4398-9f7b-336c6b578116 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:13.674962 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-436de7c6-84b6-4398-9f7b-336c6b578116 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:13.675268 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-8142462c-bc37-42d4-ae66-d8f769e825b7 req-b8e3d723-1eb3-4d14-8c94-65ac63a8437d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec8a5228-091c-490d-8790-3cd53e77b5d1", "tag": "086e5891-69d8-40bc-9506-7d948bca1db9"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:13.676497 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-436de7c6-84b6-4398-9f7b-336c6b578116 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:13.677026 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-436de7c6-84b6-4398-9f7b-336c6b578116 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:13.677692 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-436de7c6-84b6-4398-9f7b-336c6b578116 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:13.691744 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-8142462c-bc37-42d4-ae66-d8f769e825b7 req-b8e3d723-1eb3-4d14-8c94-65ac63a8437d service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:13.692580 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-8142462c-bc37-42d4-ae66-d8f769e825b7 req-b8e3d723-1eb3-4d14-8c94-65ac63a8437d service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:13.693300 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-8142462c-bc37-42d4-ae66-d8f769e825b7 req-b8e3d723-1eb3-4d14-8c94-65ac63a8437d service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:13.711337 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-8142462c-bc37-42d4-ae66-d8f769e825b7 req-b8e3d723-1eb3-4d14-8c94-65ac63a8437d service nova] Creating event network-changed:086e5891-69d8-40bc-9506-7d948bca1db9 for instance ec8a5228-091c-490d-8790-3cd53e77b5d1 on hv-cinder-85220 Sep 01 16:44:13.715097 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-436de7c6-84b6-4398-9f7b-336c6b578116 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Going to try to terminate instance {{(pid=127178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:44:13.720850 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-8142462c-bc37-42d4-ae66-d8f769e825b7 req-b8e3d723-1eb3-4d14-8c94-65ac63a8437d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049613 Sep 01 16:44:13.727342 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 565/1096] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:44:13.816124 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-436de7c6-84b6-4398-9f7b-336c6b578116 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 204 len: 0 microversion: 2.1 time: 0.160518 Sep 01 16:44:13.816727 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 532/1097] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:44:13 2022] DELETE /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:44:13.825909 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a2a77be9-f565-4719-ad82-2061a6683ae1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:13.826637 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a2a77be9-f565-4719-ad82-2061a6683ae1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:13.833326 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2a77be9-f565-4719-ad82-2061a6683ae1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:13.833809 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2a77be9-f565-4719-ad82-2061a6683ae1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:13.834264 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2a77be9-f565-4719-ad82-2061a6683ae1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:13.834989 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2a77be9-f565-4719-ad82-2061a6683ae1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:13.835439 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2a77be9-f565-4719-ad82-2061a6683ae1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:13.835858 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2a77be9-f565-4719-ad82-2061a6683ae1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:13.992911 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a2a77be9-f565-4719-ad82-2061a6683ae1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:14.001442 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a2a77be9-f565-4719-ad82-2061a6683ae1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1577 microversion: 2.1 time: 0.180126 Sep 01 16:44:14.015748 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 566/1098] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:13 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:14.065889 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-4c9bb4f7-c6ca-4310-9eb9-07156b5266cf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:14.066854 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-4c9bb4f7-c6ca-4310-9eb9-07156b5266cf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:14.073443 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4c9bb4f7-c6ca-4310-9eb9-07156b5266cf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:14.073931 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4c9bb4f7-c6ca-4310-9eb9-07156b5266cf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:14.074660 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4c9bb4f7-c6ca-4310-9eb9-07156b5266cf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:14.075376 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4c9bb4f7-c6ca-4310-9eb9-07156b5266cf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:14.075868 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4c9bb4f7-c6ca-4310-9eb9-07156b5266cf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:14.076731 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-4c9bb4f7-c6ca-4310-9eb9-07156b5266cf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:14.269998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-4c9bb4f7-c6ca-4310-9eb9-07156b5266cf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:14.278476 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-4c9bb4f7-c6ca-4310-9eb9-07156b5266cf tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1566 microversion: 2.1 time: 0.216968 Sep 01 16:44:14.279135 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 533/1099] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:14 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:15.023718 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8eaac6c3-0e23-40a4-bf62-cde4af141284 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:15.024303 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8eaac6c3-0e23-40a4-bf62-cde4af141284 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:15.030869 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8eaac6c3-0e23-40a4-bf62-cde4af141284 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:15.031398 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8eaac6c3-0e23-40a4-bf62-cde4af141284 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:15.031828 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8eaac6c3-0e23-40a4-bf62-cde4af141284 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:15.032519 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8eaac6c3-0e23-40a4-bf62-cde4af141284 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:15.032967 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8eaac6c3-0e23-40a4-bf62-cde4af141284 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:15.033432 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8eaac6c3-0e23-40a4-bf62-cde4af141284 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:15.171094 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8eaac6c3-0e23-40a4-bf62-cde4af141284 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:15.179883 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8eaac6c3-0e23-40a4-bf62-cde4af141284 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1577 microversion: 2.1 time: 0.160163 Sep 01 16:44:15.180484 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 567/1100] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:15 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:15.302021 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-0a45c8e4-9fde-4a5f-a15f-2df85d023872 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:15.302890 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-0a45c8e4-9fde-4a5f-a15f-2df85d023872 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:15.309641 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0a45c8e4-9fde-4a5f-a15f-2df85d023872 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:15.310143 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0a45c8e4-9fde-4a5f-a15f-2df85d023872 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:15.310604 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0a45c8e4-9fde-4a5f-a15f-2df85d023872 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:15.311302 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0a45c8e4-9fde-4a5f-a15f-2df85d023872 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:15.311749 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0a45c8e4-9fde-4a5f-a15f-2df85d023872 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:15.312171 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-0a45c8e4-9fde-4a5f-a15f-2df85d023872 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:15.460866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-0a45c8e4-9fde-4a5f-a15f-2df85d023872 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:15.468238 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-0a45c8e4-9fde-4a5f-a15f-2df85d023872 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1566 microversion: 2.1 time: 0.170912 Sep 01 16:44:15.469067 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 534/1101] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:15 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:16.200846 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dacec3d7-1e30-4b67-8228-787050914d43 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:16.201480 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-dacec3d7-1e30-4b67-8228-787050914d43 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:16.208429 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dacec3d7-1e30-4b67-8228-787050914d43 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:16.208904 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dacec3d7-1e30-4b67-8228-787050914d43 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:16.209334 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dacec3d7-1e30-4b67-8228-787050914d43 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:16.210021 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dacec3d7-1e30-4b67-8228-787050914d43 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:16.210489 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dacec3d7-1e30-4b67-8228-787050914d43 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:16.210905 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dacec3d7-1e30-4b67-8228-787050914d43 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:16.354217 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dacec3d7-1e30-4b67-8228-787050914d43 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:16.371685 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-dacec3d7-1e30-4b67-8228-787050914d43 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1577 microversion: 2.1 time: 0.174607 Sep 01 16:44:16.372274 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 568/1102] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:16 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:16.491085 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-041c4128-b8f5-4def-a302-3ef699786fd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:16.491767 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-041c4128-b8f5-4def-a302-3ef699786fd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:16.498967 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-041c4128-b8f5-4def-a302-3ef699786fd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:16.499544 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-041c4128-b8f5-4def-a302-3ef699786fd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:16.500125 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-041c4128-b8f5-4def-a302-3ef699786fd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:16.500969 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-041c4128-b8f5-4def-a302-3ef699786fd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:16.501526 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-041c4128-b8f5-4def-a302-3ef699786fd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:16.501948 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-041c4128-b8f5-4def-a302-3ef699786fd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:16.638465 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-041c4128-b8f5-4def-a302-3ef699786fd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:16.647041 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-041c4128-b8f5-4def-a302-3ef699786fd8 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1566 microversion: 2.1 time: 0.160263 Sep 01 16:44:16.647635 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 535/1103] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:16 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:17.397332 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f884e034-574c-4f71-b525-488d1767f950 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:17.398101 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f884e034-574c-4f71-b525-488d1767f950 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:17.404991 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f884e034-574c-4f71-b525-488d1767f950 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:17.405477 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f884e034-574c-4f71-b525-488d1767f950 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:17.405909 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f884e034-574c-4f71-b525-488d1767f950 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:17.406639 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f884e034-574c-4f71-b525-488d1767f950 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:17.407090 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f884e034-574c-4f71-b525-488d1767f950 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:17.407510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f884e034-574c-4f71-b525-488d1767f950 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:17.562993 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f884e034-574c-4f71-b525-488d1767f950 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:17.571243 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f884e034-574c-4f71-b525-488d1767f950 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1577 microversion: 2.1 time: 0.178759 Sep 01 16:44:17.571822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 569/1104] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:17 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:17.668130 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-091d2115-4f0d-4f2a-8f54-0c28ca84e578 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:17.668736 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-091d2115-4f0d-4f2a-8f54-0c28ca84e578 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:17.675344 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-091d2115-4f0d-4f2a-8f54-0c28ca84e578 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:17.676386 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-091d2115-4f0d-4f2a-8f54-0c28ca84e578 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:17.676771 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-091d2115-4f0d-4f2a-8f54-0c28ca84e578 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:17.677733 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-091d2115-4f0d-4f2a-8f54-0c28ca84e578 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:17.677956 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-091d2115-4f0d-4f2a-8f54-0c28ca84e578 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:17.678345 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-091d2115-4f0d-4f2a-8f54-0c28ca84e578 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:18.012764 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-091d2115-4f0d-4f2a-8f54-0c28ca84e578 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:18.021063 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-091d2115-4f0d-4f2a-8f54-0c28ca84e578 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1566 microversion: 2.1 time: 0.356794 Sep 01 16:44:18.021645 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 536/1105] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:17 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1566 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:44:18.251532 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-40906f4b-8639-4478-af97-00437e617d50 req-4024ab72-fd77-4297-8783-44ba123a6b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec8a5228-091c-490d-8790-3cd53e77b5d1", "name": "network-vif-deleted", "tag": "086e5891-69d8-40bc-9506-7d948bca1db9"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:18.262779 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-40906f4b-8639-4478-af97-00437e617d50 req-4024ab72-fd77-4297-8783-44ba123a6b43 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:18.263365 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-40906f4b-8639-4478-af97-00437e617d50 req-4024ab72-fd77-4297-8783-44ba123a6b43 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:18.263810 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-40906f4b-8639-4478-af97-00437e617d50 req-4024ab72-fd77-4297-8783-44ba123a6b43 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:18.281753 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-40906f4b-8639-4478-af97-00437e617d50 req-4024ab72-fd77-4297-8783-44ba123a6b43 service nova] Creating event network-vif-deleted:086e5891-69d8-40bc-9506-7d948bca1db9 for instance ec8a5228-091c-490d-8790-3cd53e77b5d1 on hv-cinder-85220 Sep 01 16:44:18.286706 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-40906f4b-8639-4478-af97-00437e617d50 req-4024ab72-fd77-4297-8783-44ba123a6b43 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039405 Sep 01 16:44:18.287347 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 570/1106] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:44:18.592707 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b518fea3-cad4-499a-a6b5-ef53a82f32e8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:18.593552 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b518fea3-cad4-499a-a6b5-ef53a82f32e8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:18.600598 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b518fea3-cad4-499a-a6b5-ef53a82f32e8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:18.601282 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b518fea3-cad4-499a-a6b5-ef53a82f32e8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:18.601911 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b518fea3-cad4-499a-a6b5-ef53a82f32e8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:18.602821 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b518fea3-cad4-499a-a6b5-ef53a82f32e8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:18.603486 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b518fea3-cad4-499a-a6b5-ef53a82f32e8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:18.603930 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b518fea3-cad4-499a-a6b5-ef53a82f32e8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:18.717117 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b518fea3-cad4-499a-a6b5-ef53a82f32e8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3059f5115bb4bad837daf9f18752143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bf55e6c5e47f3895e135c4d6dc3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:18.727018 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b518fea3-cad4-499a-a6b5-ef53a82f32e8 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 200 len: 1225 microversion: 2.1 time: 0.138275 Sep 01 16:44:18.727598 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 537/1107] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:18 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 1225 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:19.043652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-485448eb-bffc-4780-ae87-6418248c15a1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:19.044270 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-485448eb-bffc-4780-ae87-6418248c15a1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:19.050381 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-485448eb-bffc-4780-ae87-6418248c15a1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:19.050878 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-485448eb-bffc-4780-ae87-6418248c15a1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:19.051298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-485448eb-bffc-4780-ae87-6418248c15a1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:19.051974 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-485448eb-bffc-4780-ae87-6418248c15a1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:19.052416 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-485448eb-bffc-4780-ae87-6418248c15a1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:19.052826 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-485448eb-bffc-4780-ae87-6418248c15a1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:19.086379 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-485448eb-bffc-4780-ae87-6418248c15a1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:19.086865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-485448eb-bffc-4780-ae87-6418248c15a1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:19.087299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-485448eb-bffc-4780-ae87-6418248c15a1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:19.087739 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-485448eb-bffc-4780-ae87-6418248c15a1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lazy-loading 'fault' on Instance uuid fad0df24-0b95-4583-9017-6322bebd55a0 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:44:19.133439 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-485448eb-bffc-4780-ae87-6418248c15a1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6ad9c2c1294633a74782c668227886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683a11c21fe4dd389a006f051576a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:19.142891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-485448eb-bffc-4780-ae87-6418248c15a1 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 200 len: 1224 microversion: 2.1 time: 0.104608 Sep 01 16:44:19.143563 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 571/1108] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:19 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:19.747780 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d4afa1ce-93f5-4e51-a2fa-b7097d6a1cb7 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:19.748339 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-d4afa1ce-93f5-4e51-a2fa-b7097d6a1cb7 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: ec8a5228-091c-490d-8790-3cd53e77b5d1] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:19.754688 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4afa1ce-93f5-4e51-a2fa-b7097d6a1cb7 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:19.755198 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4afa1ce-93f5-4e51-a2fa-b7097d6a1cb7 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:19.755631 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4afa1ce-93f5-4e51-a2fa-b7097d6a1cb7 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:19.756327 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4afa1ce-93f5-4e51-a2fa-b7097d6a1cb7 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:19.756776 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4afa1ce-93f5-4e51-a2fa-b7097d6a1cb7 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:19.757201 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-d4afa1ce-93f5-4e51-a2fa-b7097d6a1cb7 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:19.771618 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-d4afa1ce-93f5-4e51-a2fa-b7097d6a1cb7 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] HTTP exception thrown: Instance ec8a5228-091c-490d-8790-3cd53e77b5d1 could not be found. Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d4afa1ce-93f5-4e51-a2fa-b7097d6a1cb7 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Request method failure captured: Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 HTTP/1.1 Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN97HOKS9R-V8DgrBoRJO26WuPh_i2vM7On4Gl0HRk0g1m7yeMKkG5i083NgJ-nZpc0UQUxBDaiPb0hMA7EoGz6-TWv1RfzGfrvYBpMeN9gFsW_iVL61zLNeE3FauMkLRNWoLCx9Vl2WG6Q8cLIFRhdExCCMwWlX8XLFz3EoF1zKnBA Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: 4b6bf55e6c5e47f3895e135c4d6dc3ff Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-TestVolumeBootPattern-1980304612 Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:44:19.773375 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:44:19.775222 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:44:19.775222 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-TestVolumeBootPattern-1980304612 Sep 01 16:44:19.775222 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: 4b6bf55e6c5e47f3895e135c4d6dc3ff Sep 01 16:44:19.775222 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-TestVolumeBootPattern-1980304612 Sep 01 16:44:19.775222 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-TestVolumeBootPattern-1980304612-project Sep 01 16:44:19.775222 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:44:19.775222 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:44:19.775222 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: a3059f5115bb4bad837daf9f18752143 Sep 01 16:44:19.775222 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-TestVolumeBootPattern-1980304612-project Sep 01 16:44:19.775222 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:44:19.775222 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance ec8a5228-091c-490d-8790-3cd53e77b5d1 could not be found. Sep 01 16:44:19.775222 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': 'ec8a5228-091c-490d-8790-3cd53e77b5d1'} Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec8a5228-091c-490d-8790-3cd53e77b5d1 could not be found. Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:44:19.776144 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec8a5228-091c-490d-8790-3cd53e77b5d1 could not be found. Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec8a5228-091c-490d-8790-3cd53e77b5d1 could not be found. Sep 01 16:44:19.777817 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:44:19.779396 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-d4afa1ce-93f5-4e51-a2fa-b7097d6a1cb7 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Returning 404 to user: Instance ec8a5228-091c-490d-8790-3cd53e77b5d1 could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:44:19.779396 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-d4afa1ce-93f5-4e51-a2fa-b7097d6a1cb7 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1" status: 404 len: 111 microversion: 2.1 time: 0.031223 Sep 01 16:44:19.779396 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 538/1109] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:19 2022] GET /compute/v2.1/servers/ec8a5228-091c-490d-8790-3cd53e77b5d1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:44:20.172861 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f16b0ac3-ca9a-4d45-b661-53a128e2dc18 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:20.173724 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f16b0ac3-ca9a-4d45-b661-53a128e2dc18 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] [instance: fad0df24-0b95-4583-9017-6322bebd55a0] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:20.180928 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f16b0ac3-ca9a-4d45-b661-53a128e2dc18 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:20.181414 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f16b0ac3-ca9a-4d45-b661-53a128e2dc18 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:20.181848 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f16b0ac3-ca9a-4d45-b661-53a128e2dc18 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:20.182576 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f16b0ac3-ca9a-4d45-b661-53a128e2dc18 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:20.183031 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f16b0ac3-ca9a-4d45-b661-53a128e2dc18 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:20.183498 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f16b0ac3-ca9a-4d45-b661-53a128e2dc18 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:20.198193 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-f16b0ac3-ca9a-4d45-b661-53a128e2dc18 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] HTTP exception thrown: Instance fad0df24-0b95-4583-9017-6322bebd55a0 could not be found. Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f16b0ac3-ca9a-4d45-b661-53a128e2dc18 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Request method failure captured: Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 HTTP/1.1 Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEOBExy7d6LdZJLHj-iVpl2QH5PNL_mFQ5JGh7ZY48t5gfUTfkpsKVcfX3BpH8daLzfRto6H5YDsFPsN3nGzbu7u19KaqdoSoS3qVd2CA6iyqG71xnxY3g94LrkdSuO93ADzzcPhMKmvZAZcEks6kWlfnws86kWJ3JPqSEAAw0YOMs-4 Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: b683a11c21fe4dd389a006f051576a1b Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-TestShelveInstance-1499203960 Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:44:20.199884 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:44:20.201583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b683a11c21fe4dd389a006f051576a1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b683a11c21fe4dd389a006f051576a1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b683a11c21fe4dd389a006f051576a1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b683a11c21fe4dd389a006f051576a1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:44:20.201583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-TestShelveInstance-1499203960 Sep 01 16:44:20.201583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: b683a11c21fe4dd389a006f051576a1b Sep 01 16:44:20.201583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-TestShelveInstance-1499203960 Sep 01 16:44:20.201583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-TestShelveInstance-1499203960-project Sep 01 16:44:20.201583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:44:20.201583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:44:20.201583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: aa6ad9c2c1294633a74782c668227886 Sep 01 16:44:20.201583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-TestShelveInstance-1499203960-project Sep 01 16:44:20.201583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:44:20.201583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance fad0df24-0b95-4583-9017-6322bebd55a0 could not be found. Sep 01 16:44:20.201583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': 'fad0df24-0b95-4583-9017-6322bebd55a0'} Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fad0df24-0b95-4583-9017-6322bebd55a0 could not be found. Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:44:20.202565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fad0df24-0b95-4583-9017-6322bebd55a0 could not be found. Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fad0df24-0b95-4583-9017-6322bebd55a0 could not be found. Sep 01 16:44:20.204130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:20.205471 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f16b0ac3-ca9a-4d45-b661-53a128e2dc18 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Returning 404 to user: Instance fad0df24-0b95-4583-9017-6322bebd55a0 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:44:20.205471 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f16b0ac3-ca9a-4d45-b661-53a128e2dc18 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0" status: 404 len: 111 microversion: 2.1 time: 0.032809 Sep 01 16:44:20.205471 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 572/1110] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:20 2022] GET /compute/v2.1/servers/fad0df24-0b95-4583-9017-6322bebd55a0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:44:20.254334 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e8aaeb86-9fd3-49ad-8477-5c2fec57beb1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:20.254831 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-e8aaeb86-9fd3-49ad-8477-5c2fec57beb1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:20.261617 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8aaeb86-9fd3-49ad-8477-5c2fec57beb1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:20.262081 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8aaeb86-9fd3-49ad-8477-5c2fec57beb1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:20.262673 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8aaeb86-9fd3-49ad-8477-5c2fec57beb1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:20.263466 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8aaeb86-9fd3-49ad-8477-5c2fec57beb1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:20.263914 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8aaeb86-9fd3-49ad-8477-5c2fec57beb1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:20.264443 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-e8aaeb86-9fd3-49ad-8477-5c2fec57beb1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:20.280030 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-e8aaeb86-9fd3-49ad-8477-5c2fec57beb1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] HTTP exception thrown: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e8aaeb86-9fd3-49ad-8477-5c2fec57beb1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Request method failure captured: Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: DELETE /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 HTTP/1.1 Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEN97HOKS9R-V8DgrBoRJO26WuPh_i2vM7On4Gl0HRk0g1m7yeMKkG5i083NgJ-nZpc0UQUxBDaiPb0hMA7EoGz6-TWv1RfzGfrvYBpMeN9gFsW_iVL61zLNeE3FauMkLRNWoLCx9Vl2WG6Q8cLIFRhdExCCMwWlX8XLFz3EoF1zKnBA Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: 4b6bf55e6c5e47f3895e135c4d6dc3ff Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-TestVolumeBootPattern-1980304612 Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:44:20.281838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:44:20.283273 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:44:20.283273 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-TestVolumeBootPattern-1980304612 Sep 01 16:44:20.283273 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: 4b6bf55e6c5e47f3895e135c4d6dc3ff Sep 01 16:44:20.283273 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-TestVolumeBootPattern-1980304612 Sep 01 16:44:20.283273 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-TestVolumeBootPattern-1980304612-project Sep 01 16:44:20.283273 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:44:20.283273 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:44:20.283273 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: a3059f5115bb4bad837daf9f18752143 Sep 01 16:44:20.283273 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-TestVolumeBootPattern-1980304612-project Sep 01 16:44:20.283273 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:44:20.283273 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. Sep 01 16:44:20.283273 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': 'de83f04b-508f-4b6f-88da-92857f482014'} Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:44:20.284020 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. Sep 01 16:44:20.285259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:44:20.286573 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-e8aaeb86-9fd3-49ad-8477-5c2fec57beb1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Returning 404 to user: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:44:20.286573 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-e8aaeb86-9fd3-49ad-8477-5c2fec57beb1 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 404 len: 111 microversion: 2.1 time: 0.034040 Sep 01 16:44:20.286573 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 539/1111] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:44:20 2022] DELETE /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:44:20.292236 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-97145f99-51f9-4302-92f2-2611f4bdbf28 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:20.292832 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-97145f99-51f9-4302-92f2-2611f4bdbf28 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] [instance: de83f04b-508f-4b6f-88da-92857f482014] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:20.299577 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97145f99-51f9-4302-92f2-2611f4bdbf28 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:20.300588 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97145f99-51f9-4302-92f2-2611f4bdbf28 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:20.301013 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97145f99-51f9-4302-92f2-2611f4bdbf28 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:20.301701 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97145f99-51f9-4302-92f2-2611f4bdbf28 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:20.302152 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97145f99-51f9-4302-92f2-2611f4bdbf28 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:20.302379 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-62693cde-9437-4799-a575-22678cdf16fd req-e47c0c25-e45b-412f-a7db-4beb84bf8a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad0df24-0b95-4583-9017-6322bebd55a0", "name": "network-vif-deleted", "tag": "85932ff9-5198-4161-a8d5-3f43070b4618"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:20.302594 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97145f99-51f9-4302-92f2-2611f4bdbf28 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:20.312771 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-62693cde-9437-4799-a575-22678cdf16fd req-e47c0c25-e45b-412f-a7db-4beb84bf8a15 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:20.313253 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-62693cde-9437-4799-a575-22678cdf16fd req-e47c0c25-e45b-412f-a7db-4beb84bf8a15 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:20.313683 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-62693cde-9437-4799-a575-22678cdf16fd req-e47c0c25-e45b-412f-a7db-4beb84bf8a15 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:20.319426 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-97145f99-51f9-4302-92f2-2611f4bdbf28 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] HTTP exception thrown: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-97145f99-51f9-4302-92f2-2611f4bdbf28 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Request method failure captured: Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 HTTP/1.1 Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEN97HOKS9R-V8DgrBoRJO26WuPh_i2vM7On4Gl0HRk0g1m7yeMKkG5i083NgJ-nZpc0UQUxBDaiPb0hMA7EoGz6-TWv1RfzGfrvYBpMeN9gFsW_iVL61zLNeE3FauMkLRNWoLCx9Vl2WG6Q8cLIFRhdExCCMwWlX8XLFz3EoF1zKnBA Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 4b6bf55e6c5e47f3895e135c4d6dc3ff Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-TestVolumeBootPattern-1980304612 Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:44:20.320940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:44:20.322346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4b6bf55e6c5e47f3895e135c4d6dc3ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:44:20.322346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-TestVolumeBootPattern-1980304612 Sep 01 16:44:20.322346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 4b6bf55e6c5e47f3895e135c4d6dc3ff Sep 01 16:44:20.322346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-TestVolumeBootPattern-1980304612 Sep 01 16:44:20.322346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-TestVolumeBootPattern-1980304612-project Sep 01 16:44:20.322346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:44:20.322346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:44:20.322346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: a3059f5115bb4bad837daf9f18752143 Sep 01 16:44:20.322346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-TestVolumeBootPattern-1980304612-project Sep 01 16:44:20.322346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:44:20.322346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. Sep 01 16:44:20.322346 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': 'de83f04b-508f-4b6f-88da-92857f482014'} Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:44:20.323097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. Sep 01 16:44:20.324957 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:20.326394 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-97145f99-51f9-4302-92f2-2611f4bdbf28 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Returning 404 to user: Instance de83f04b-508f-4b6f-88da-92857f482014 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:44:20.326394 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-97145f99-51f9-4302-92f2-2611f4bdbf28 tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014" status: 404 len: 111 microversion: 2.1 time: 0.033943 Sep 01 16:44:20.328925 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 573/1112] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:20 2022] GET /compute/v2.1/servers/de83f04b-508f-4b6f-88da-92857f482014 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:44:20.330037 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-62693cde-9437-4799-a575-22678cdf16fd req-e47c0c25-e45b-412f-a7db-4beb84bf8a15 service nova] Creating event network-vif-deleted:85932ff9-5198-4161-a8d5-3f43070b4618 for instance fad0df24-0b95-4583-9017-6322bebd55a0 on hv-cinder-85220 Sep 01 16:44:20.336499 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-62693cde-9437-4799-a575-22678cdf16fd req-e47c0c25-e45b-412f-a7db-4beb84bf8a15 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038051 Sep 01 16:44:20.337403 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 540/1113] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:44:20.385466 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-223babc2-01ca-4232-adf7-d2a1b88a4117 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] Calling method '.version_select at 0x7feeec1fa940>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:20.420335 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-223babc2-01ca-4232-adf7-d2a1b88a4117 tempest-TestShelveInstance-1499203960 tempest-TestShelveInstance-1499203960-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-343666896" status: 202 len: 0 microversion: 2.1 time: 0.039805 Sep 01 16:44:20.421360 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 574/1114] 10.222.0.18 () {58 vars in 1251 bytes} [Thu Sep 1 16:44:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-343666896 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:44:21.671590 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-dd298279-d633-4f5f-bece-db75edba29ca tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] Calling method '.version_select at 0x7feeec050940>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:21.696985 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-dd298279-d633-4f5f-bece-db75edba29ca tempest-TestVolumeBootPattern-1980304612 tempest-TestVolumeBootPattern-1980304612-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-346534431" status: 202 len: 0 microversion: 2.1 time: 0.030633 Sep 01 16:44:21.697747 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 541/1115] 10.222.0.18 () {58 vars in 1260 bytes} [Thu Sep 1 16:44:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-346534431 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:44:35.960830 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:44:35.961510 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Thu Sep 1 16:44:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791/ips (ip 10.222.0.18) !!! Sep 01 16:44:35.962141 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=57 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:35.962891 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:35.967474 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-307cfaca-5e80-4016-9ede-1c41f42fee38 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:35.967962 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-307cfaca-5e80-4016-9ede-1c41f42fee38 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:35.976922 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-307cfaca-5e80-4016-9ede-1c41f42fee38 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:35.977459 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-307cfaca-5e80-4016-9ede-1c41f42fee38 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:35.977893 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-307cfaca-5e80-4016-9ede-1c41f42fee38 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:35.978622 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-307cfaca-5e80-4016-9ede-1c41f42fee38 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:35.979073 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-307cfaca-5e80-4016-9ede-1c41f42fee38 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:35.979497 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-307cfaca-5e80-4016-9ede-1c41f42fee38 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:36.004209 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-307cfaca-5e80-4016-9ede-1c41f42fee38 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791/ips" status: 200 len: 148 microversion: 2.1 time: 0.045034 Sep 01 16:44:36.004842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 575/1116] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 1 16:44:35 2022] GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791/ips => generated 148 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:37.329379 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:37.330102 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:37.334578 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7eba15a1-8b48-455f-98f4-7fa6c94b1141 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77b3d0a9-d2c8-4760-ade4-aaaeba21ff8a"}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:37.336950 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7eba15a1-8b48-455f-98f4-7fa6c94b1141 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:37.345399 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7eba15a1-8b48-455f-98f4-7fa6c94b1141 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:37.345984 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7eba15a1-8b48-455f-98f4-7fa6c94b1141 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:37.346701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7eba15a1-8b48-455f-98f4-7fa6c94b1141 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:37.347404 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7eba15a1-8b48-455f-98f4-7fa6c94b1141 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:37.347853 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7eba15a1-8b48-455f-98f4-7fa6c94b1141 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:37.348269 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7eba15a1-8b48-455f-98f4-7fa6c94b1141 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:37.612928 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7eba15a1-8b48-455f-98f4-7fa6c94b1141 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "POST /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285102 Sep 01 16:44:37.613529 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 542/1117] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 1 16:44:37 2022] POST /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:45.154736 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6073405a-d6cc-4591-9bdb-591139a0e12b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77b3d0a9-d2c8-4760-ade4-aaaeba21ff8a"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:45.157015 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6073405a-d6cc-4591-9bdb-591139a0e12b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:45.163619 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6073405a-d6cc-4591-9bdb-591139a0e12b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:45.164092 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6073405a-d6cc-4591-9bdb-591139a0e12b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:45.164521 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6073405a-d6cc-4591-9bdb-591139a0e12b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:45.165195 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6073405a-d6cc-4591-9bdb-591139a0e12b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:45.165636 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6073405a-d6cc-4591-9bdb-591139a0e12b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:45.166046 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6073405a-d6cc-4591-9bdb-591139a0e12b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:45.245404 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-6073405a-d6cc-4591-9bdb-591139a0e12b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] HTTP exception thrown: Invalid volume: volume 77b3d0a9-d2c8-4760-ade4-aaaeba21ff8a is already attached to instances: c11dd8bc-ee5b-47f8-b54b-d5486b441791 Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6073405a-d6cc-4591-9bdb-591139a0e12b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Request method failure captured: Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: POST /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791/os-volume_attachments HTTP/1.1 Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 74 Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEODFnwPNfevD_s2iqgjrJrwl5tsyQLcUPwsFoLuOLaCBQxUF3Innp8Fna8O4TdSVd9vYWEGFlMlL0SYz-lEDdpM7EPUs1IhWx7AcC2L6kveO3EqsUOvxYoQnZ0Lnpw-Lp1qby82G6PYCqAS-tNEfIiz9X92KchUl7n5MX3Dah7x9N0Y Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:44:45.247016 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:44:45.248633 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:44:45.248633 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:44:45.248633 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:44:45.248633 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:44:45.248633 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:44:45.248633 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:44:45.248633 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:44:45.248633 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: a237b400429f4200909581e3c5e0cbfb Sep 01 16:44:45.248633 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:44:45.248633 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Sep 01 16:44:45.248633 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {"volumeAttachment": {"volumeId": "77b3d0a9-d2c8-4760-ade4-aaaeba21ff8a"}} Sep 01 16:44:45.248633 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Invalid volume: volume 77b3d0a9-d2c8-4760-ade4-aaaeba21ff8a is already attached to instances: c11dd8bc-ee5b-47f8-b54b-d5486b441791 Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'server_id': 'c11dd8bc-ee5b-47f8-b54b-d5486b441791', 'body': {'volumeAttachment': {'volumeId': '77b3d0a9-d2c8-4760-ade4-aaaeba21ff8a'}}} Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 77b3d0a9-d2c8-4760-ade4-aaaeba21ff8a is already attached to instances: c11dd8bc-ee5b-47f8-b54b-d5486b441791 Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:45.249630 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 77b3d0a9-d2c8-4760-ade4-aaaeba21ff8a is already attached to instances: c11dd8bc-ee5b-47f8-b54b-d5486b441791 Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:45.251179 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:45.252882 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:45.252882 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:44:45.252882 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:44:45.252882 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 77b3d0a9-d2c8-4760-ade4-aaaeba21ff8a is already attached to instances: c11dd8bc-ee5b-47f8-b54b-d5486b441791 Sep 01 16:44:45.252882 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:44:45.252882 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6073405a-d6cc-4591-9bdb-591139a0e12b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Returning 400 to user: Invalid volume: volume 77b3d0a9-d2c8-4760-ade4-aaaeba21ff8a is already attached to instances: c11dd8bc-ee5b-47f8-b54b-d5486b441791 {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:44:45.252882 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6073405a-d6cc-4591-9bdb-591139a0e12b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "POST /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097673 Sep 01 16:44:45.252882 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 576/1118] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 1 16:44:45 2022] POST /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:44:45.312962 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-8fb777ba-3477-4ef9-8360-866f45cda5c4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:45.313542 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-8fb777ba-3477-4ef9-8360-866f45cda5c4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:45.319826 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8fb777ba-3477-4ef9-8360-866f45cda5c4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:45.320298 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8fb777ba-3477-4ef9-8360-866f45cda5c4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:45.320730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8fb777ba-3477-4ef9-8360-866f45cda5c4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:45.321413 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8fb777ba-3477-4ef9-8360-866f45cda5c4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:45.321858 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8fb777ba-3477-4ef9-8360-866f45cda5c4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:45.322298 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8fb777ba-3477-4ef9-8360-866f45cda5c4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:45.405322 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.objects.instance [None req-8fb777ba-3477-4ef9-8360-866f45cda5c4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lazy-loading 'services' on Instance uuid c11dd8bc-ee5b-47f8-b54b-d5486b441791 {{(pid=127178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:44:45.479493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-8fb777ba-3477-4ef9-8360-866f45cda5c4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791/os-volume_attachments/77b3d0a9-d2c8-4760-ade4-aaaeba21ff8a" status: 202 len: 0 microversion: 2.1 time: 0.170009 Sep 01 16:44:45.480345 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 543/1119] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 1 16:44:45 2022] DELETE /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791/os-volume_attachments/77b3d0a9-d2c8-4760-ade4-aaaeba21ff8a => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:44:45.488169 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-02d2a952-684b-4d47-a396-b6477ea85ca4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:45.490338 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-02d2a952-684b-4d47-a396-b6477ea85ca4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:45.496458 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02d2a952-684b-4d47-a396-b6477ea85ca4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:45.496943 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02d2a952-684b-4d47-a396-b6477ea85ca4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:45.497377 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02d2a952-684b-4d47-a396-b6477ea85ca4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:45.498085 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02d2a952-684b-4d47-a396-b6477ea85ca4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:45.498590 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02d2a952-684b-4d47-a396-b6477ea85ca4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:45.499014 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02d2a952-684b-4d47-a396-b6477ea85ca4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:45.532410 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-02d2a952-684b-4d47-a396-b6477ea85ca4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048131 Sep 01 16:44:45.533162 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 577/1120] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:44:45 2022] GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:44:46.546152 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-3409097f-59c5-484e-af4a-fbffdd5653a5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:46.548502 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-3409097f-59c5-484e-af4a-fbffdd5653a5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:46.555306 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3409097f-59c5-484e-af4a-fbffdd5653a5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:46.555788 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3409097f-59c5-484e-af4a-fbffdd5653a5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:46.556222 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3409097f-59c5-484e-af4a-fbffdd5653a5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:46.556915 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3409097f-59c5-484e-af4a-fbffdd5653a5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:46.557364 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3409097f-59c5-484e-af4a-fbffdd5653a5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:46.557790 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3409097f-59c5-484e-af4a-fbffdd5653a5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:46.587423 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-3409097f-59c5-484e-af4a-fbffdd5653a5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046134 Sep 01 16:44:46.587985 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 544/1121] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:44:46 2022] GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:44:46.649629 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e4296b23-ae5d-4bb1-a8ca-afda48a80afe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:46.650212 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e4296b23-ae5d-4bb1-a8ca-afda48a80afe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:46.656671 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4296b23-ae5d-4bb1-a8ca-afda48a80afe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:46.657141 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4296b23-ae5d-4bb1-a8ca-afda48a80afe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:46.657605 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4296b23-ae5d-4bb1-a8ca-afda48a80afe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:46.658366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4296b23-ae5d-4bb1-a8ca-afda48a80afe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:46.658822 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4296b23-ae5d-4bb1-a8ca-afda48a80afe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:46.659231 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4296b23-ae5d-4bb1-a8ca-afda48a80afe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:46.684379 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e4296b23-ae5d-4bb1-a8ca-afda48a80afe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:44:46.765353 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e4296b23-ae5d-4bb1-a8ca-afda48a80afe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791" status: 204 len: 0 microversion: 2.1 time: 0.118798 Sep 01 16:44:46.766430 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 578/1122] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:44:46 2022] DELETE /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:44:46.775933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-40d3c9bc-7a79-46a4-b8f4-e05c8de7d904 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:46.776539 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-40d3c9bc-7a79-46a4-b8f4-e05c8de7d904 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:46.782450 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40d3c9bc-7a79-46a4-b8f4-e05c8de7d904 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:46.782921 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40d3c9bc-7a79-46a4-b8f4-e05c8de7d904 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:46.783913 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40d3c9bc-7a79-46a4-b8f4-e05c8de7d904 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:46.784591 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40d3c9bc-7a79-46a4-b8f4-e05c8de7d904 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:46.785034 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40d3c9bc-7a79-46a4-b8f4-e05c8de7d904 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:46.785454 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40d3c9bc-7a79-46a4-b8f4-e05c8de7d904 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:46.914959 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-40d3c9bc-7a79-46a4-b8f4-e05c8de7d904 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:46.922739 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-40d3c9bc-7a79-46a4-b8f4-e05c8de7d904 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791" status: 200 len: 1679 microversion: 2.1 time: 0.150669 Sep 01 16:44:46.923311 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 545/1123] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:46 2022] GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:47.945926 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2ed2fd20-690d-432e-9b53-841fc5c6a23a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:47.946656 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2ed2fd20-690d-432e-9b53-841fc5c6a23a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:47.953048 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ed2fd20-690d-432e-9b53-841fc5c6a23a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:47.953524 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ed2fd20-690d-432e-9b53-841fc5c6a23a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:47.953963 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ed2fd20-690d-432e-9b53-841fc5c6a23a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:47.954685 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ed2fd20-690d-432e-9b53-841fc5c6a23a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:47.955156 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ed2fd20-690d-432e-9b53-841fc5c6a23a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:47.955576 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ed2fd20-690d-432e-9b53-841fc5c6a23a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:48.098552 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2ed2fd20-690d-432e-9b53-841fc5c6a23a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:48.106378 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2ed2fd20-690d-432e-9b53-841fc5c6a23a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791" status: 200 len: 1679 microversion: 2.1 time: 0.165794 Sep 01 16:44:48.106944 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 579/1124] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:47 2022] GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:49.126612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-40f50fb2-80bb-416c-b777-1bd4fe4eff37 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:49.127857 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-40f50fb2-80bb-416c-b777-1bd4fe4eff37 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:49.134633 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40f50fb2-80bb-416c-b777-1bd4fe4eff37 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:49.135122 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40f50fb2-80bb-416c-b777-1bd4fe4eff37 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:49.135554 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40f50fb2-80bb-416c-b777-1bd4fe4eff37 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:49.136254 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40f50fb2-80bb-416c-b777-1bd4fe4eff37 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:49.136706 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40f50fb2-80bb-416c-b777-1bd4fe4eff37 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:49.137128 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-40f50fb2-80bb-416c-b777-1bd4fe4eff37 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:49.232823 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-40f50fb2-80bb-416c-b777-1bd4fe4eff37 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:49.240965 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-40f50fb2-80bb-416c-b777-1bd4fe4eff37 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791" status: 200 len: 1611 microversion: 2.1 time: 0.118277 Sep 01 16:44:49.254269 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 546/1125] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:49 2022] GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 => generated 1611 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:49.544439 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-36cdef1b-8c1f-4e8c-9269-38d723c892f2 req-edd0b751-e246-414a-9b79-0f60e0908000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c11dd8bc-ee5b-47f8-b54b-d5486b441791", "name": "network-vif-deleted", "tag": "5fa0b631-72cd-4970-bb22-e93cf21f9acc"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:49.554941 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-36cdef1b-8c1f-4e8c-9269-38d723c892f2 req-edd0b751-e246-414a-9b79-0f60e0908000 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:49.555416 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-36cdef1b-8c1f-4e8c-9269-38d723c892f2 req-edd0b751-e246-414a-9b79-0f60e0908000 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:49.555843 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-36cdef1b-8c1f-4e8c-9269-38d723c892f2 req-edd0b751-e246-414a-9b79-0f60e0908000 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:49.567552 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-36cdef1b-8c1f-4e8c-9269-38d723c892f2 req-edd0b751-e246-414a-9b79-0f60e0908000 service nova] Creating event network-vif-deleted:5fa0b631-72cd-4970-bb22-e93cf21f9acc for instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 on hv-cinder-85220 Sep 01 16:44:49.572476 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-36cdef1b-8c1f-4e8c-9269-38d723c892f2 req-edd0b751-e246-414a-9b79-0f60e0908000 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.272241 Sep 01 16:44:49.573086 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 580/1126] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:50.263934 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-8a4af059-28f3-4b1e-a6e7-8f6c10c4b544 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:50.264631 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-8a4af059-28f3-4b1e-a6e7-8f6c10c4b544 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:50.271997 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8a4af059-28f3-4b1e-a6e7-8f6c10c4b544 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:50.272566 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8a4af059-28f3-4b1e-a6e7-8f6c10c4b544 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:50.272998 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8a4af059-28f3-4b1e-a6e7-8f6c10c4b544 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:50.273689 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8a4af059-28f3-4b1e-a6e7-8f6c10c4b544 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:50.274130 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8a4af059-28f3-4b1e-a6e7-8f6c10c4b544 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:50.274581 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-8a4af059-28f3-4b1e-a6e7-8f6c10c4b544 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:50.288811 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-8a4af059-28f3-4b1e-a6e7-8f6c10c4b544 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] HTTP exception thrown: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-8a4af059-28f3-4b1e-a6e7-8f6c10c4b544 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Request method failure captured: Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 HTTP/1.1 Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEODFnwPNfevD_s2iqgjrJrwl5tsyQLcUPwsFoLuOLaCBQxUF3Innp8Fna8O4TdSVd9vYWEGFlMlL0SYz-lEDdpM7EPUs1IhWx7AcC2L6kveO3EqsUOvxYoQnZ0Lnpw-Lp1qby82G6PYCqAS-tNEfIiz9X92KchUl7n5MX3Dah7x9N0Y Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:44:50.290556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:44:50.292251 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:44:50.292251 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:44:50.292251 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:44:50.292251 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:44:50.292251 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:44:50.292251 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:44:50.292251 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:44:50.292251 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: a237b400429f4200909581e3c5e0cbfb Sep 01 16:44:50.292251 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:44:50.292251 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:44:50.292251 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. Sep 01 16:44:50.292251 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': 'c11dd8bc-ee5b-47f8-b54b-d5486b441791'} Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:44:50.293352 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. Sep 01 16:44:50.294901 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:44:50.296326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-8a4af059-28f3-4b1e-a6e7-8f6c10c4b544 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Returning 404 to user: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:44:50.296326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-8a4af059-28f3-4b1e-a6e7-8f6c10c4b544 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791" status: 404 len: 111 microversion: 2.1 time: 0.031942 Sep 01 16:44:50.296326 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 547/1127] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:50 2022] GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:44:50.302021 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5bee4f31-3003-485b-81f5-32af6b95b1d7 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '.version_select at 0x7feeec1e18b0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:50.321883 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5bee4f31-3003-485b-81f5-32af6b95b1d7 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-553599726" status: 202 len: 0 microversion: 2.1 time: 0.024127 Sep 01 16:44:50.322508 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 581/1128] 10.222.0.18 () {58 vars in 1218 bytes} [Thu Sep 1 16:44:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-553599726 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:44:50.958664 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-3f4445fb-c22a-4434-b98d-0cba9c673da5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Action: 'create', calling method: .version_select at 0x7feeec172280>, body: {"keypair": {"name": "tempest-keypair-810348937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNGOC/VZZggh3G+nGe8zeIsAuuxp7mqXTYuxNvaN3pcjwTo4jQ9fqHe+uU7FDB+eUw6BJ0BE+3oP5lIh5rpaQzsH9soM7FW8o+6hRqA3FdZSDPNZBY3W/0JOhjHwk4Fkw=="}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:50.975642 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-3f4445fb-c22a-4434-b98d-0cba9c673da5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Getting quotas for project 9b9aa20e1ffb453d9ee13dd6ae2c25ef. Resources: {'key_pairs'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:44:50.979470 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.quota [None req-3f4445fb-c22a-4434-b98d-0cba9c673da5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Getting quotas for user a237b400429f4200909581e3c5e0cbfb and project 9b9aa20e1ffb453d9ee13dd6ae2c25ef. Resources: {'key_pairs'} {{(pid=127178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:44:51.001465 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-3f4445fb-c22a-4434-b98d-0cba9c673da5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046750 Sep 01 16:44:51.002057 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 548/1129] 10.222.0.18 () {60 vars in 1159 bytes} [Thu Sep 1 16:44:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:52.300406 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1065426514", "imageRef": "46185d58-0d47-4c97-b590-0f4434aa5c9e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae0395ee-74d9-4949-89c6-cf6ebc736a46"}], "security_groups": [{"name": "tempest-securitygroup--898644368"}], "key_name": "tempest-keypair-810348937", "user_data": "}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:52.412271 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] validate_networks() for [('ae0395ee-74d9-4949-89c6-cf6ebc736a46', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:44:52.789002 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:44:52.789419 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:44:52.789886 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:44:52.790313 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:44:52.790716 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:44:52.799701 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:52.800177 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:52.800607 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:52.801325 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:52.801770 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:52.802185 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:52.821008 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Getting quotas for project 9b9aa20e1ffb453d9ee13dd6ae2c25ef. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:44:52.825148 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Getting quotas for user a237b400429f4200909581e3c5e0cbfb and project 9b9aa20e1ffb453d9ee13dd6ae2c25ef. Resources: {'instances', 'cores', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:44:52.836583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:44:52.838940 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46185d58-0d47-4c97-b590-0f4434aa5c9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:44:52.885607 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-48d14e51-7450-49ad-95c7-003b81e9fd14 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.590534 Sep 01 16:44:52.886277 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 582/1130] 10.222.0.18 () {60 vars in 1147 bytes} [Thu Sep 1 16:44:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:44:52.897987 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-81b2d0dd-af5b-4c6b-8398-23674005ea2b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:52.898637 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-81b2d0dd-af5b-4c6b-8398-23674005ea2b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:52.954430 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-81b2d0dd-af5b-4c6b-8398-23674005ea2b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:52.961844 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-81b2d0dd-af5b-4c6b-8398-23674005ea2b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f" status: 200 len: 1241 microversion: 2.1 time: 0.068247 Sep 01 16:44:52.962426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 549/1131] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:52 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:53.982854 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-145c42d2-0d2a-4139-a78b-214a98c2603a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:53.983424 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-145c42d2-0d2a-4139-a78b-214a98c2603a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:53.991225 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-145c42d2-0d2a-4139-a78b-214a98c2603a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:53.991705 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-145c42d2-0d2a-4139-a78b-214a98c2603a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:53.992191 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-145c42d2-0d2a-4139-a78b-214a98c2603a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:53.993089 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-145c42d2-0d2a-4139-a78b-214a98c2603a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:53.993760 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-145c42d2-0d2a-4139-a78b-214a98c2603a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:53.994419 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-145c42d2-0d2a-4139-a78b-214a98c2603a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:54.069042 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-145c42d2-0d2a-4139-a78b-214a98c2603a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:54.078515 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-145c42d2-0d2a-4139-a78b-214a98c2603a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f" status: 200 len: 1301 microversion: 2.1 time: 0.099541 Sep 01 16:44:54.079097 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 583/1132] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:53 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:55.101395 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-45f53800-a070-4c01-a36a-cb9030691eff tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:55.102007 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-45f53800-a070-4c01-a36a-cb9030691eff tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:55.108493 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-45f53800-a070-4c01-a36a-cb9030691eff tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:55.108983 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-45f53800-a070-4c01-a36a-cb9030691eff tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:55.109424 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-45f53800-a070-4c01-a36a-cb9030691eff tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:55.110434 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-45f53800-a070-4c01-a36a-cb9030691eff tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:55.111907 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-45f53800-a070-4c01-a36a-cb9030691eff tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:55.112537 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-45f53800-a070-4c01-a36a-cb9030691eff tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:55.326267 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-45f53800-a070-4c01-a36a-cb9030691eff tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:55.333872 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-45f53800-a070-4c01-a36a-cb9030691eff tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f" status: 200 len: 1366 microversion: 2.1 time: 0.236415 Sep 01 16:44:55.334508 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 550/1133] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:55 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:55.593791 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-179f66e1-ae96-428e-a95e-9492a99d0eb1 req-64cefc79-6e60-4fe8-ad9c-90580e4a355e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f", "tag": "0d2502a8-c2c9-4de4-bbc0-e84ad42bc788"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:55.606041 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-179f66e1-ae96-428e-a95e-9492a99d0eb1 req-64cefc79-6e60-4fe8-ad9c-90580e4a355e service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:55.606550 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-179f66e1-ae96-428e-a95e-9492a99d0eb1 req-64cefc79-6e60-4fe8-ad9c-90580e4a355e service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:55.607060 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-179f66e1-ae96-428e-a95e-9492a99d0eb1 req-64cefc79-6e60-4fe8-ad9c-90580e4a355e service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:55.618617 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-179f66e1-ae96-428e-a95e-9492a99d0eb1 req-64cefc79-6e60-4fe8-ad9c-90580e4a355e service nova] Creating event network-changed:0d2502a8-c2c9-4de4-bbc0-e84ad42bc788 for instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f on hv-cinder-85220 Sep 01 16:44:55.623551 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-179f66e1-ae96-428e-a95e-9492a99d0eb1 req-64cefc79-6e60-4fe8-ad9c-90580e4a355e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033500 Sep 01 16:44:55.624147 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 584/1134] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:44:56.361393 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-a47715f1-90c3-4d01-80cc-d9832eeba7a1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:56.361393 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-a47715f1-90c3-4d01-80cc-d9832eeba7a1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:56.379001 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a47715f1-90c3-4d01-80cc-d9832eeba7a1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:56.379613 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a47715f1-90c3-4d01-80cc-d9832eeba7a1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:56.380145 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a47715f1-90c3-4d01-80cc-d9832eeba7a1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:56.381264 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a47715f1-90c3-4d01-80cc-d9832eeba7a1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:56.381928 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a47715f1-90c3-4d01-80cc-d9832eeba7a1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:56.382581 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-a47715f1-90c3-4d01-80cc-d9832eeba7a1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:56.518506 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-a47715f1-90c3-4d01-80cc-d9832eeba7a1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:56.526507 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-a47715f1-90c3-4d01-80cc-d9832eeba7a1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f" status: 200 len: 1366 microversion: 2.1 time: 0.175182 Sep 01 16:44:56.527109 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 551/1135] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:56 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:57.548246 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-59609f3a-9a11-4b1d-90c2-596bc99e9cf0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:57.548976 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-59609f3a-9a11-4b1d-90c2-596bc99e9cf0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:57.555066 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59609f3a-9a11-4b1d-90c2-596bc99e9cf0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:57.555539 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59609f3a-9a11-4b1d-90c2-596bc99e9cf0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:57.556006 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59609f3a-9a11-4b1d-90c2-596bc99e9cf0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:57.556715 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59609f3a-9a11-4b1d-90c2-596bc99e9cf0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:57.557161 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59609f3a-9a11-4b1d-90c2-596bc99e9cf0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:57.557578 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59609f3a-9a11-4b1d-90c2-596bc99e9cf0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:57.694959 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-59609f3a-9a11-4b1d-90c2-596bc99e9cf0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:57.702735 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-59609f3a-9a11-4b1d-90c2-596bc99e9cf0 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f" status: 200 len: 1366 microversion: 2.1 time: 0.159184 Sep 01 16:44:57.703298 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 585/1136] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:57 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:58.724410 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-b7b9c226-c36a-4f03-ae0a-168f10f22be1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:58.725007 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-b7b9c226-c36a-4f03-ae0a-168f10f22be1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:58.731399 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7b9c226-c36a-4f03-ae0a-168f10f22be1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:58.731871 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7b9c226-c36a-4f03-ae0a-168f10f22be1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:58.732298 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7b9c226-c36a-4f03-ae0a-168f10f22be1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:58.732975 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7b9c226-c36a-4f03-ae0a-168f10f22be1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:58.733426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7b9c226-c36a-4f03-ae0a-168f10f22be1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:58.733838 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-b7b9c226-c36a-4f03-ae0a-168f10f22be1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:58.862547 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-b7b9c226-c36a-4f03-ae0a-168f10f22be1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:58.870208 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-b7b9c226-c36a-4f03-ae0a-168f10f22be1 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f" status: 200 len: 1366 microversion: 2.1 time: 0.150411 Sep 01 16:44:58.870804 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 552/1137] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:58 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:59.891286 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2b469901-ba33-4b89-ad90-5c7ba56774e6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:59.892095 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2b469901-ba33-4b89-ad90-5c7ba56774e6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:59.898661 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2b469901-ba33-4b89-ad90-5c7ba56774e6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:59.899141 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2b469901-ba33-4b89-ad90-5c7ba56774e6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:59.899564 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2b469901-ba33-4b89-ad90-5c7ba56774e6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:59.900255 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2b469901-ba33-4b89-ad90-5c7ba56774e6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:59.900699 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2b469901-ba33-4b89-ad90-5c7ba56774e6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:59.901128 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2b469901-ba33-4b89-ad90-5c7ba56774e6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:00.039554 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2b469901-ba33-4b89-ad90-5c7ba56774e6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:00.047768 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2b469901-ba33-4b89-ad90-5c7ba56774e6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f" status: 200 len: 1366 microversion: 2.1 time: 0.160335 Sep 01 16:45:00.048349 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 586/1138] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:59 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:00.186627 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-4bd56662-0bb6-425a-9645-bc9a771a43d3 req-302ffa26-3c8e-4a9f-882a-83fa5c19380b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f", "name": "network-vif-plugged", "status": "completed", "tag": "0d2502a8-c2c9-4de4-bbc0-e84ad42bc788"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:00.196846 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-4bd56662-0bb6-425a-9645-bc9a771a43d3 req-302ffa26-3c8e-4a9f-882a-83fa5c19380b service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:00.197329 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-4bd56662-0bb6-425a-9645-bc9a771a43d3 req-302ffa26-3c8e-4a9f-882a-83fa5c19380b service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:00.197757 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-4bd56662-0bb6-425a-9645-bc9a771a43d3 req-302ffa26-3c8e-4a9f-882a-83fa5c19380b service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:00.209637 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-4bd56662-0bb6-425a-9645-bc9a771a43d3 req-302ffa26-3c8e-4a9f-882a-83fa5c19380b service nova] Creating event network-vif-plugged:0d2502a8-c2c9-4de4-bbc0-e84ad42bc788 for instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f on hv-cinder-85220 Sep 01 16:45:00.214689 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-4bd56662-0bb6-425a-9645-bc9a771a43d3 req-302ffa26-3c8e-4a9f-882a-83fa5c19380b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032090 Sep 01 16:45:00.215302 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 553/1139] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:01.069592 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-508959f4-6ff1-4cbf-bd21-855954329ec6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:01.070214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-508959f4-6ff1-4cbf-bd21-855954329ec6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:01.076732 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-508959f4-6ff1-4cbf-bd21-855954329ec6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:01.077216 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-508959f4-6ff1-4cbf-bd21-855954329ec6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:01.077648 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-508959f4-6ff1-4cbf-bd21-855954329ec6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:01.078366 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-508959f4-6ff1-4cbf-bd21-855954329ec6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:01.078819 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-508959f4-6ff1-4cbf-bd21-855954329ec6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:01.079235 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-508959f4-6ff1-4cbf-bd21-855954329ec6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:01.207614 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-508959f4-6ff1-4cbf-bd21-855954329ec6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:01.215226 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-508959f4-6ff1-4cbf-bd21-855954329ec6 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f" status: 200 len: 1366 microversion: 2.1 time: 0.150102 Sep 01 16:45:01.215787 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 587/1140] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:01 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:02.237604 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f38fc750-fa14-473b-a992-3d76c86dc82a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:02.238209 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f38fc750-fa14-473b-a992-3d76c86dc82a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:02.244635 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f38fc750-fa14-473b-a992-3d76c86dc82a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:02.245110 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f38fc750-fa14-473b-a992-3d76c86dc82a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:02.245540 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f38fc750-fa14-473b-a992-3d76c86dc82a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:02.246224 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f38fc750-fa14-473b-a992-3d76c86dc82a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:02.246691 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f38fc750-fa14-473b-a992-3d76c86dc82a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:02.247107 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f38fc750-fa14-473b-a992-3d76c86dc82a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:02.377502 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-f38fc750-fa14-473b-a992-3d76c86dc82a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:02.387190 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f38fc750-fa14-473b-a992-3d76c86dc82a tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f" status: 200 len: 1556 microversion: 2.1 time: 0.154383 Sep 01 16:45:02.387784 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 554/1141] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:02 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:02.409047 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-19642773-6054-4e7f-9b62-12487c189c1d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:02.409644 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-19642773-6054-4e7f-9b62-12487c189c1d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:02.416440 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-19642773-6054-4e7f-9b62-12487c189c1d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:02.416983 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-19642773-6054-4e7f-9b62-12487c189c1d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:02.417465 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-19642773-6054-4e7f-9b62-12487c189c1d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:02.418311 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-19642773-6054-4e7f-9b62-12487c189c1d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:02.418807 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-19642773-6054-4e7f-9b62-12487c189c1d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:02.419276 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-19642773-6054-4e7f-9b62-12487c189c1d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:02.501653 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-19642773-6054-4e7f-9b62-12487c189c1d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097103 Sep 01 16:45:02.502485 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 588/1142] 10.222.0.18 () {58 vars in 1275 bytes} [Thu Sep 1 16:45:02 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:03.464966 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-f60da533-c080-4ea8-a6d2-3418234e8632 req-b3d2b9f0-f177-4111-8226-30619ded96b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f", "tag": "0d2502a8-c2c9-4de4-bbc0-e84ad42bc788"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:03.469953 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell0:SELECT=6 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:03.477114 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-f60da533-c080-4ea8-a6d2-3418234e8632 req-b3d2b9f0-f177-4111-8226-30619ded96b9 service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:03.477593 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-f60da533-c080-4ea8-a6d2-3418234e8632 req-b3d2b9f0-f177-4111-8226-30619ded96b9 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:03.478025 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-f60da533-c080-4ea8-a6d2-3418234e8632 req-b3d2b9f0-f177-4111-8226-30619ded96b9 service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:03.490426 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-f60da533-c080-4ea8-a6d2-3418234e8632 req-b3d2b9f0-f177-4111-8226-30619ded96b9 service nova] Creating event network-changed:0d2502a8-c2c9-4de4-bbc0-e84ad42bc788 for instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f on hv-cinder-85220 Sep 01 16:45:03.495409 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-f60da533-c080-4ea8-a6d2-3418234e8632 req-b3d2b9f0-f177-4111-8226-30619ded96b9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033993 Sep 01 16:45:03.496014 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 555/1143] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:38.314055 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:38.315469 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=6 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:38.316835 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:38.317569 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:38.322302 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dcfb993d-5af4-4d0b-9cf5-3cd46b34cfed tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:38.322833 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-dcfb993d-5af4-4d0b-9cf5-3cd46b34cfed tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:38.331834 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dcfb993d-5af4-4d0b-9cf5-3cd46b34cfed tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:38.332396 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dcfb993d-5af4-4d0b-9cf5-3cd46b34cfed tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:38.332865 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dcfb993d-5af4-4d0b-9cf5-3cd46b34cfed tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:38.333596 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dcfb993d-5af4-4d0b-9cf5-3cd46b34cfed tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:38.334084 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dcfb993d-5af4-4d0b-9cf5-3cd46b34cfed tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:38.334577 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dcfb993d-5af4-4d0b-9cf5-3cd46b34cfed tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:38.360482 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-dcfb993d-5af4-4d0b-9cf5-3cd46b34cfed tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f/ips" status: 200 len: 149 microversion: 2.1 time: 0.047188 Sep 01 16:45:38.361053 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 589/1144] 10.222.0.18 () {58 vars in 1248 bytes} [Thu Sep 1 16:45:38 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:39.677943 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:39.678754 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG dbcounter [-] [127178] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:39.683077 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-9eb7566f-4f42-4a3a-a412-4d15a4ab377d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "271c9380-8433-4309-9400-7e4eecb186a4"}} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:39.685460 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-9eb7566f-4f42-4a3a-a412-4d15a4ab377d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:39.692835 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9eb7566f-4f42-4a3a-a412-4d15a4ab377d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:39.693315 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9eb7566f-4f42-4a3a-a412-4d15a4ab377d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:39.693745 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9eb7566f-4f42-4a3a-a412-4d15a4ab377d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:39.694462 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9eb7566f-4f42-4a3a-a412-4d15a4ab377d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:39.694911 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9eb7566f-4f42-4a3a-a412-4d15a4ab377d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:39.695328 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-9eb7566f-4f42-4a3a-a412-4d15a4ab377d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:39.967648 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-9eb7566f-4f42-4a3a-a412-4d15a4ab377d tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "POST /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291191 Sep 01 16:45:39.968265 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 556/1145] 10.222.0.18 () {60 vars in 1323 bytes} [Thu Sep 1 16:45:39 2022] POST /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:47.620558 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c3fcc139-356d-4836-bb7f-68361c2eab43 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:47.621118 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c3fcc139-356d-4836-bb7f-68361c2eab43 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:47.628197 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3fcc139-356d-4836-bb7f-68361c2eab43 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:47.628680 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3fcc139-356d-4836-bb7f-68361c2eab43 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:47.629107 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3fcc139-356d-4836-bb7f-68361c2eab43 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:47.629799 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3fcc139-356d-4836-bb7f-68361c2eab43 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:47.630259 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3fcc139-356d-4836-bb7f-68361c2eab43 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:47.630683 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3fcc139-356d-4836-bb7f-68361c2eab43 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:47.714565 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-c3fcc139-356d-4836-bb7f-68361c2eab43 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lazy-loading 'services' on Instance uuid a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:45:47.789210 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c3fcc139-356d-4836-bb7f-68361c2eab43 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f/os-volume_attachments/271c9380-8433-4309-9400-7e4eecb186a4" status: 202 len: 0 microversion: 2.1 time: 0.172533 Sep 01 16:45:47.789897 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 590/1146] 10.222.0.18 () {58 vars in 1416 bytes} [Thu Sep 1 16:45:47 2022] DELETE /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f/os-volume_attachments/271c9380-8433-4309-9400-7e4eecb186a4 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:45:47.799770 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-3e38ca2f-eb4c-4420-86e2-106ef9028746 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:47.802118 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-3e38ca2f-eb4c-4420-86e2-106ef9028746 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:47.809189 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e38ca2f-eb4c-4420-86e2-106ef9028746 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:47.809673 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e38ca2f-eb4c-4420-86e2-106ef9028746 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:47.810098 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e38ca2f-eb4c-4420-86e2-106ef9028746 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:47.810840 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e38ca2f-eb4c-4420-86e2-106ef9028746 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:47.811284 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e38ca2f-eb4c-4420-86e2-106ef9028746 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:47.811719 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-3e38ca2f-eb4c-4420-86e2-106ef9028746 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:47.852193 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-3e38ca2f-eb4c-4420-86e2-106ef9028746 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057275 Sep 01 16:45:47.852771 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 557/1147] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:45:47 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:48.866393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d7f5a4dd-61ee-46ee-a661-fa27468ee7e5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:48.868777 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d7f5a4dd-61ee-46ee-a661-fa27468ee7e5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:48.875260 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7f5a4dd-61ee-46ee-a661-fa27468ee7e5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:48.875735 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7f5a4dd-61ee-46ee-a661-fa27468ee7e5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:48.876165 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7f5a4dd-61ee-46ee-a661-fa27468ee7e5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:48.876862 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7f5a4dd-61ee-46ee-a661-fa27468ee7e5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:48.877864 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7f5a4dd-61ee-46ee-a661-fa27468ee7e5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:48.878310 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7f5a4dd-61ee-46ee-a661-fa27468ee7e5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:48.914579 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d7f5a4dd-61ee-46ee-a661-fa27468ee7e5 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053655 Sep 01 16:45:48.915146 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 591/1148] 10.222.0.18 () {58 vars in 1302 bytes} [Thu Sep 1 16:45:48 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:45:48.977350 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-7aff81e3-4633-4e2a-a00a-c53433562778 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:48.977938 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7aff81e3-4633-4e2a-a00a-c53433562778 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:48.984383 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7aff81e3-4633-4e2a-a00a-c53433562778 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:48.984860 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7aff81e3-4633-4e2a-a00a-c53433562778 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:48.985288 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7aff81e3-4633-4e2a-a00a-c53433562778 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:48.985979 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7aff81e3-4633-4e2a-a00a-c53433562778 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:48.987023 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7aff81e3-4633-4e2a-a00a-c53433562778 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:48.987438 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-7aff81e3-4633-4e2a-a00a-c53433562778 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:49.013730 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-7aff81e3-4633-4e2a-a00a-c53433562778 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Going to try to terminate instance {{(pid=127178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:45:49.092846 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-7aff81e3-4633-4e2a-a00a-c53433562778 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f" status: 204 len: 0 microversion: 2.1 time: 0.118613 Sep 01 16:45:49.094086 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 558/1149] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:45:48 2022] DELETE /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:45:49.102429 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d66fee95-bceb-49de-ac7a-664204605e94 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:49.103038 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d66fee95-bceb-49de-ac7a-664204605e94 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:49.109094 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d66fee95-bceb-49de-ac7a-664204605e94 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:49.109581 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d66fee95-bceb-49de-ac7a-664204605e94 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:49.110014 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d66fee95-bceb-49de-ac7a-664204605e94 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:49.110749 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d66fee95-bceb-49de-ac7a-664204605e94 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:49.111211 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d66fee95-bceb-49de-ac7a-664204605e94 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:49.112130 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d66fee95-bceb-49de-ac7a-664204605e94 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:49.250105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d66fee95-bceb-49de-ac7a-664204605e94 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:49.258362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d66fee95-bceb-49de-ac7a-664204605e94 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f" status: 200 len: 1680 microversion: 2.1 time: 0.159841 Sep 01 16:45:49.258933 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 592/1150] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:49 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:50.281082 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-10fdf5cb-c97f-4a1e-a65a-dd518ddeb9e4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:50.281777 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-10fdf5cb-c97f-4a1e-a65a-dd518ddeb9e4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:50.288984 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10fdf5cb-c97f-4a1e-a65a-dd518ddeb9e4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:50.289462 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10fdf5cb-c97f-4a1e-a65a-dd518ddeb9e4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:50.289888 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10fdf5cb-c97f-4a1e-a65a-dd518ddeb9e4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:50.290605 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10fdf5cb-c97f-4a1e-a65a-dd518ddeb9e4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:50.291060 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10fdf5cb-c97f-4a1e-a65a-dd518ddeb9e4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:50.291461 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-10fdf5cb-c97f-4a1e-a65a-dd518ddeb9e4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:50.433486 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.policy [None req-10fdf5cb-c97f-4a1e-a65a-dd518ddeb9e4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:50.441354 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-10fdf5cb-c97f-4a1e-a65a-dd518ddeb9e4 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f" status: 200 len: 1680 microversion: 2.1 time: 0.164595 Sep 01 16:45:50.441935 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 559/1151] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:50 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:51.462829 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-faa43640-6f2f-4e6a-b4b4-e1e976adcf0e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:51.463423 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-faa43640-6f2f-4e6a-b4b4-e1e976adcf0e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:51.470324 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-faa43640-6f2f-4e6a-b4b4-e1e976adcf0e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:51.471323 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-faa43640-6f2f-4e6a-b4b4-e1e976adcf0e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:51.471877 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-faa43640-6f2f-4e6a-b4b4-e1e976adcf0e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:51.472828 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-faa43640-6f2f-4e6a-b4b4-e1e976adcf0e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:51.473277 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-faa43640-6f2f-4e6a-b4b4-e1e976adcf0e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:51.473696 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-faa43640-6f2f-4e6a-b4b4-e1e976adcf0e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:51.543054 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-faa43640-6f2f-4e6a-b4b4-e1e976adcf0e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a237b400429f4200909581e3c5e0cbfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9aa20e1ffb453d9ee13dd6ae2c25ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:51.554897 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-faa43640-6f2f-4e6a-b4b4-e1e976adcf0e tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f" status: 200 len: 1613 microversion: 2.1 time: 0.096041 Sep 01 16:45:51.555702 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 593/1152] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:51 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f => generated 1613 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:51.616667 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [req-853befc9-51a6-40e6-8ba2-76ec70be3f84 req-d31ece81-94b9-4c94-a18d-8de494029dcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f", "name": "network-vif-deleted", "tag": "0d2502a8-c2c9-4de4-bbc0-e84ad42bc788"}]} {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:51.627346 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-853befc9-51a6-40e6-8ba2-76ec70be3f84 req-d31ece81-94b9-4c94-a18d-8de494029dcb service nova] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:51.627845 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-853befc9-51a6-40e6-8ba2-76ec70be3f84 req-d31ece81-94b9-4c94-a18d-8de494029dcb service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:51.628259 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [req-853befc9-51a6-40e6-8ba2-76ec70be3f84 req-d31ece81-94b9-4c94-a18d-8de494029dcb service nova] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:51.651063 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.compute.server_external_events [req-853befc9-51a6-40e6-8ba2-76ec70be3f84 req-d31ece81-94b9-4c94-a18d-8de494029dcb service nova] Creating event network-vif-deleted:0d2502a8-c2c9-4de4-bbc0-e84ad42bc788 for instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f on hv-cinder-85220 Sep 01 16:45:51.657101 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [req-853befc9-51a6-40e6-8ba2-76ec70be3f84 req-d31ece81-94b9-4c94-a18d-8de494029dcb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043749 Sep 01 16:45:51.658045 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 560/1153] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Sep 1 16:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:52.576269 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6e743a4f-792c-4d98-ba9a-e33e9eea4412 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:52.577154 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6e743a4f-792c-4d98-ba9a-e33e9eea4412 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:52.585293 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e743a4f-792c-4d98-ba9a-e33e9eea4412 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:52.585759 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e743a4f-792c-4d98-ba9a-e33e9eea4412 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:52.586182 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e743a4f-792c-4d98-ba9a-e33e9eea4412 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:52.586920 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e743a4f-792c-4d98-ba9a-e33e9eea4412 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:52.587362 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e743a4f-792c-4d98-ba9a-e33e9eea4412 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:52.587773 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6e743a4f-792c-4d98-ba9a-e33e9eea4412 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:52.603583 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-6e743a4f-792c-4d98-ba9a-e33e9eea4412 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] HTTP exception thrown: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6e743a4f-792c-4d98-ba9a-e33e9eea4412 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Request method failure captured: Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f HTTP/1.1 Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEODFnwPNfevD_s2iqgjrJrwl5tsyQLcUPwsFoLuOLaCBQxUF3Innp8Fna8O4TdSVd9vYWEGFlMlL0SYz-lEDdpM7EPUs1IhWx7AcC2L6kveO3EqsUOvxYoQnZ0Lnpw-Lp1qby82G6PYCqAS-tNEfIiz9X92KchUl7n5MX3Dah7x9N0Y Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:45:52.605247 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:45:52.607166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:45:52.607166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:52.607166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:52.607166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:52.607166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:52.607166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:45:52.607166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:45:52.607166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: a237b400429f4200909581e3c5e0cbfb Sep 01 16:45:52.607166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:52.607166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:45:52.607166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. Sep 01 16:45:52.607166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': 'a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f'} Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:52.608012 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. Sep 01 16:45:52.609393 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:52.612391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6e743a4f-792c-4d98-ba9a-e33e9eea4412 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Returning 404 to user: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:52.612391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6e743a4f-792c-4d98-ba9a-e33e9eea4412 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f" status: 404 len: 111 microversion: 2.1 time: 0.034591 Sep 01 16:45:52.612391 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 594/1154] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:52 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:52.616752 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-da8888ac-16db-49d1-823b-39338e66f80b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '.version_select at 0x7feeec104280>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:52.639255 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-da8888ac-16db-49d1-823b-39338e66f80b tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-810348937" status: 202 len: 0 microversion: 2.1 time: 0.026661 Sep 01 16:45:52.639849 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 561/1155] 10.222.0.18 () {58 vars in 1218 bytes} [Thu Sep 1 16:45:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-810348937 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:45:54.434114 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b3bfd9c5-7b9d-4127-8014-cc9cc85fe42f tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:54.434661 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b3bfd9c5-7b9d-4127-8014-cc9cc85fe42f tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:54.441678 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b3bfd9c5-7b9d-4127-8014-cc9cc85fe42f tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:54.442154 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b3bfd9c5-7b9d-4127-8014-cc9cc85fe42f tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:54.442612 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b3bfd9c5-7b9d-4127-8014-cc9cc85fe42f tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:54.443305 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b3bfd9c5-7b9d-4127-8014-cc9cc85fe42f tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:54.443751 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b3bfd9c5-7b9d-4127-8014-cc9cc85fe42f tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:54.444166 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b3bfd9c5-7b9d-4127-8014-cc9cc85fe42f tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:54.457842 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-b3bfd9c5-7b9d-4127-8014-cc9cc85fe42f tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] HTTP exception thrown: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b3bfd9c5-7b9d-4127-8014-cc9cc85fe42f tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Request method failure captured: Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: DELETE /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f HTTP/1.1 Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEODFnwPNfevD_s2iqgjrJrwl5tsyQLcUPwsFoLuOLaCBQxUF3Innp8Fna8O4TdSVd9vYWEGFlMlL0SYz-lEDdpM7EPUs1IhWx7AcC2L6kveO3EqsUOvxYoQnZ0Lnpw-Lp1qby82G6PYCqAS-tNEfIiz9X92KchUl7n5MX3Dah7x9N0Y Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:45:54.459431 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:45:54.461082 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:45:54.461082 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:54.461082 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:54.461082 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:54.461082 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:54.461082 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:45:54.461082 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:45:54.461082 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: a237b400429f4200909581e3c5e0cbfb Sep 01 16:45:54.461082 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:54.461082 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:45:54.461082 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. Sep 01 16:45:54.461082 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': 'a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f'} Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:54.462357 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. Sep 01 16:45:54.463887 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:54.465599 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b3bfd9c5-7b9d-4127-8014-cc9cc85fe42f tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Returning 404 to user: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:54.465599 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b3bfd9c5-7b9d-4127-8014-cc9cc85fe42f tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f" status: 404 len: 111 microversion: 2.1 time: 0.030577 Sep 01 16:45:54.465599 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 595/1156] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:45:54 2022] DELETE /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:54.472699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-abcd6c12-9dd0-42ac-bd83-312dad5418fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:54.473495 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-abcd6c12-9dd0-42ac-bd83-312dad5418fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:54.485520 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-abcd6c12-9dd0-42ac-bd83-312dad5418fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:54.486284 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-abcd6c12-9dd0-42ac-bd83-312dad5418fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:54.487525 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-abcd6c12-9dd0-42ac-bd83-312dad5418fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:54.489668 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-abcd6c12-9dd0-42ac-bd83-312dad5418fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:54.489668 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-abcd6c12-9dd0-42ac-bd83-312dad5418fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:54.489668 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-abcd6c12-9dd0-42ac-bd83-312dad5418fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:54.503572 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-abcd6c12-9dd0-42ac-bd83-312dad5418fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] HTTP exception thrown: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-abcd6c12-9dd0-42ac-bd83-312dad5418fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Request method failure captured: Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f HTTP/1.1 Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEODFnwPNfevD_s2iqgjrJrwl5tsyQLcUPwsFoLuOLaCBQxUF3Innp8Fna8O4TdSVd9vYWEGFlMlL0SYz-lEDdpM7EPUs1IhWx7AcC2L6kveO3EqsUOvxYoQnZ0Lnpw-Lp1qby82G6PYCqAS-tNEfIiz9X92KchUl7n5MX3Dah7x9N0Y Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:45:54.505313 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:45:54.506991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:45:54.506991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:54.506991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:54.506991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:54.506991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:54.506991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:45:54.506991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:45:54.506991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: a237b400429f4200909581e3c5e0cbfb Sep 01 16:45:54.506991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:54.506991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:45:54.506991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. Sep 01 16:45:54.506991 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': 'a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f'} Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:54.508010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. Sep 01 16:45:54.509866 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:54.511437 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-abcd6c12-9dd0-42ac-bd83-312dad5418fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Returning 404 to user: Instance a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:54.511437 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-abcd6c12-9dd0-42ac-bd83-312dad5418fe tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f" status: 404 len: 111 microversion: 2.1 time: 0.040937 Sep 01 16:45:54.511437 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 562/1157] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:54 2022] GET /compute/v2.1/servers/a6d4ac6d-daa9-4356-b6e3-03dceee9bc5f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:55.654560 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d9ce15a3-9f02-43b2-ae4f-bf9a12e102ea tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:55.655118 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d9ce15a3-9f02-43b2-ae4f-bf9a12e102ea tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:55.662450 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9ce15a3-9f02-43b2-ae4f-bf9a12e102ea tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:55.662927 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9ce15a3-9f02-43b2-ae4f-bf9a12e102ea tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:55.663354 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9ce15a3-9f02-43b2-ae4f-bf9a12e102ea tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:55.664049 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9ce15a3-9f02-43b2-ae4f-bf9a12e102ea tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:55.664495 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9ce15a3-9f02-43b2-ae4f-bf9a12e102ea tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:55.664913 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9ce15a3-9f02-43b2-ae4f-bf9a12e102ea tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:55.678714 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-d9ce15a3-9f02-43b2-ae4f-bf9a12e102ea tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] HTTP exception thrown: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d9ce15a3-9f02-43b2-ae4f-bf9a12e102ea tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Request method failure captured: Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: DELETE /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 HTTP/1.1 Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEODFnwPNfevD_s2iqgjrJrwl5tsyQLcUPwsFoLuOLaCBQxUF3Innp8Fna8O4TdSVd9vYWEGFlMlL0SYz-lEDdpM7EPUs1IhWx7AcC2L6kveO3EqsUOvxYoQnZ0Lnpw-Lp1qby82G6PYCqAS-tNEfIiz9X92KchUl7n5MX3Dah7x9N0Y Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:45:55.680299 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:45:55.681951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:45:55.681951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:55.681951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:55.681951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:55.681951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:55.681951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:45:55.681951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:45:55.681951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: a237b400429f4200909581e3c5e0cbfb Sep 01 16:45:55.681951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:55.681951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:45:55.681951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. Sep 01 16:45:55.681951 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': 'c11dd8bc-ee5b-47f8-b54b-d5486b441791'} Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:55.682948 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. Sep 01 16:45:55.684503 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.686758 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d9ce15a3-9f02-43b2-ae4f-bf9a12e102ea tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Returning 404 to user: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:55.686758 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d9ce15a3-9f02-43b2-ae4f-bf9a12e102ea tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791" status: 404 len: 111 microversion: 2.1 time: 0.031000 Sep 01 16:45:55.686758 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 596/1158] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:45:55 2022] DELETE /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:45:55.690154 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-33e758c5-a9b6-42bd-aa16-5520c15e2b85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:55.690799 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-33e758c5-a9b6-42bd-aa16-5520c15e2b85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: c11dd8bc-ee5b-47f8-b54b-d5486b441791] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:55.697384 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-33e758c5-a9b6-42bd-aa16-5520c15e2b85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:55.697863 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-33e758c5-a9b6-42bd-aa16-5520c15e2b85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:55.698314 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-33e758c5-a9b6-42bd-aa16-5520c15e2b85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:55.699010 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-33e758c5-a9b6-42bd-aa16-5520c15e2b85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:55.699461 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-33e758c5-a9b6-42bd-aa16-5520c15e2b85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:55.699906 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-33e758c5-a9b6-42bd-aa16-5520c15e2b85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:55.714330 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-33e758c5-a9b6-42bd-aa16-5520c15e2b85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] HTTP exception thrown: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-33e758c5-a9b6-42bd-aa16-5520c15e2b85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Request method failure captured: Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 HTTP/1.1 Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEODFnwPNfevD_s2iqgjrJrwl5tsyQLcUPwsFoLuOLaCBQxUF3Innp8Fna8O4TdSVd9vYWEGFlMlL0SYz-lEDdpM7EPUs1IhWx7AcC2L6kveO3EqsUOvxYoQnZ0Lnpw-Lp1qby82G6PYCqAS-tNEfIiz9X92KchUl7n5MX3Dah7x9N0Y Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:45:55.715869 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:45:55.717579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:45:55.717579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:55.717579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:55.717579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:55.717579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:55.717579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:45:55.717579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:45:55.717579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: a237b400429f4200909581e3c5e0cbfb Sep 01 16:45:55.717579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:55.717579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:45:55.717579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. Sep 01 16:45:55.717579 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': 'c11dd8bc-ee5b-47f8-b54b-d5486b441791'} Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:55.718451 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. Sep 01 16:45:55.720006 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.721904 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-33e758c5-a9b6-42bd-aa16-5520c15e2b85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Returning 404 to user: Instance c11dd8bc-ee5b-47f8-b54b-d5486b441791 could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:55.721904 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-33e758c5-a9b6-42bd-aa16-5520c15e2b85 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791" status: 404 len: 111 microversion: 2.1 time: 0.030821 Sep 01 16:45:55.721904 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 563/1159] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:55 2022] GET /compute/v2.1/servers/c11dd8bc-ee5b-47f8-b54b-d5486b441791 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:55.726616 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3ba85e51-d3bc-48f3-b2b1-d2ac0f15eea7 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:55.727111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3ba85e51-d3bc-48f3-b2b1-d2ac0f15eea7 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:55.733171 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ba85e51-d3bc-48f3-b2b1-d2ac0f15eea7 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:55.733652 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ba85e51-d3bc-48f3-b2b1-d2ac0f15eea7 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:55.734105 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ba85e51-d3bc-48f3-b2b1-d2ac0f15eea7 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:55.734807 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ba85e51-d3bc-48f3-b2b1-d2ac0f15eea7 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:55.735256 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ba85e51-d3bc-48f3-b2b1-d2ac0f15eea7 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:55.735676 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ba85e51-d3bc-48f3-b2b1-d2ac0f15eea7 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:55.749486 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-3ba85e51-d3bc-48f3-b2b1-d2ac0f15eea7 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] HTTP exception thrown: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3ba85e51-d3bc-48f3-b2b1-d2ac0f15eea7 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Request method failure captured: Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: DELETE /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d HTTP/1.1 Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEODFnwPNfevD_s2iqgjrJrwl5tsyQLcUPwsFoLuOLaCBQxUF3Innp8Fna8O4TdSVd9vYWEGFlMlL0SYz-lEDdpM7EPUs1IhWx7AcC2L6kveO3EqsUOvxYoQnZ0Lnpw-Lp1qby82G6PYCqAS-tNEfIiz9X92KchUl7n5MX3Dah7x9N0Y Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:45:55.751063 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:45:55.752836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:45:55.752836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:55.752836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:55.752836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:55.752836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:55.752836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:45:55.752836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:45:55.752836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: a237b400429f4200909581e3c5e0cbfb Sep 01 16:45:55.752836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:55.752836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:45:55.752836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. Sep 01 16:45:55.752836 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': 'd3520487-5780-44b3-9e04-28492a42939d'} Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:55.754214 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. Sep 01 16:45:55.757233 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.759872 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3ba85e51-d3bc-48f3-b2b1-d2ac0f15eea7 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Returning 404 to user: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:55.759872 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3ba85e51-d3bc-48f3-b2b1-d2ac0f15eea7 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d" status: 404 len: 111 microversion: 2.1 time: 0.029688 Sep 01 16:45:55.759872 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 597/1160] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:45:55 2022] DELETE /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:55.761274 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-18185e6a-5d00-4872-a50a-0a96c32f1bf9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:55.761872 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-18185e6a-5d00-4872-a50a-0a96c32f1bf9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: d3520487-5780-44b3-9e04-28492a42939d] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:55.768486 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-18185e6a-5d00-4872-a50a-0a96c32f1bf9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:55.768962 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-18185e6a-5d00-4872-a50a-0a96c32f1bf9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:55.769388 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-18185e6a-5d00-4872-a50a-0a96c32f1bf9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:55.770066 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-18185e6a-5d00-4872-a50a-0a96c32f1bf9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:55.770544 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-18185e6a-5d00-4872-a50a-0a96c32f1bf9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:55.770958 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-18185e6a-5d00-4872-a50a-0a96c32f1bf9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:55.785319 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-18185e6a-5d00-4872-a50a-0a96c32f1bf9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] HTTP exception thrown: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-18185e6a-5d00-4872-a50a-0a96c32f1bf9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Request method failure captured: Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d HTTP/1.1 Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEODFnwPNfevD_s2iqgjrJrwl5tsyQLcUPwsFoLuOLaCBQxUF3Innp8Fna8O4TdSVd9vYWEGFlMlL0SYz-lEDdpM7EPUs1IhWx7AcC2L6kveO3EqsUOvxYoQnZ0Lnpw-Lp1qby82G6PYCqAS-tNEfIiz9X92KchUl7n5MX3Dah7x9N0Y Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:45:55.786933 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:45:55.788556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:45:55.788556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:55.788556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:55.788556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:55.788556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:55.788556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:45:55.788556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:45:55.788556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: a237b400429f4200909581e3c5e0cbfb Sep 01 16:45:55.788556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:55.788556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:45:55.788556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. Sep 01 16:45:55.788556 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': 'd3520487-5780-44b3-9e04-28492a42939d'} Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:55.789381 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. Sep 01 16:45:55.790699 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:55.791811 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-18185e6a-5d00-4872-a50a-0a96c32f1bf9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Returning 404 to user: Instance d3520487-5780-44b3-9e04-28492a42939d could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:55.791811 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-18185e6a-5d00-4872-a50a-0a96c32f1bf9 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d" status: 404 len: 111 microversion: 2.1 time: 0.030930 Sep 01 16:45:55.791811 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 564/1161] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:55 2022] GET /compute/v2.1/servers/d3520487-5780-44b3-9e04-28492a42939d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:56.933257 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-51d3dea0-1674-4caf-b72b-e133fca4b520 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:56.933911 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-51d3dea0-1674-4caf-b72b-e133fca4b520 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:56.940594 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-51d3dea0-1674-4caf-b72b-e133fca4b520 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:56.941074 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-51d3dea0-1674-4caf-b72b-e133fca4b520 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:56.941500 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-51d3dea0-1674-4caf-b72b-e133fca4b520 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:56.942194 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-51d3dea0-1674-4caf-b72b-e133fca4b520 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:56.942669 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-51d3dea0-1674-4caf-b72b-e133fca4b520 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:56.943090 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-51d3dea0-1674-4caf-b72b-e133fca4b520 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:56.956877 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-51d3dea0-1674-4caf-b72b-e133fca4b520 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] HTTP exception thrown: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-51d3dea0-1674-4caf-b72b-e133fca4b520 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Request method failure captured: Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: request: DELETE /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff HTTP/1.1 Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept: application/json Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Connection: close Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Length: 0 Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Content-Type: application/json Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Host: 10.222.0.18 Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjEODFnwPNfevD_s2iqgjrJrwl5tsyQLcUPwsFoLuOLaCBQxUF3Innp8Fna8O4TdSVd9vYWEGFlMlL0SYz-lEDdpM7EPUs1IhWx7AcC2L6kveO3EqsUOvxYoQnZ0Lnpw-Lp1qby82G6PYCqAS-tNEfIiz9X92KchUl7n5MX3Dah7x9N0Y Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Role: reader,member Sep 01 16:45:56.958455 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Sep 01 16:45:56.960111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:45:56.960111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:56.960111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:56.960111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:56.960111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:56.960111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Sep 01 16:45:56.960111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Sep 01 16:45:56.960111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Id: a237b400429f4200909581e3c5e0cbfb Sep 01 16:45:56.960111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:56.960111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: method: > Sep 01 16:45:56.960111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: exception: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. Sep 01 16:45:56.960111 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: action_args: {'id': '870a289a-9e2c-4471-ac02-f9aa77461aff'} Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:56.961018 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. Sep 01 16:45:56.962566 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Sep 01 16:45:56.963972 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-51d3dea0-1674-4caf-b72b-e133fca4b520 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Returning 404 to user: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:56.963972 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-51d3dea0-1674-4caf-b72b-e133fca4b520 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "DELETE /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff" status: 404 len: 111 microversion: 2.1 time: 0.030550 Sep 01 16:45:56.963972 dv-cinder-852209-10-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 598/1162] 10.222.0.18 () {58 vars in 1239 bytes} [Thu Sep 1 16:45:56 2022] DELETE /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:56.968475 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f1a4f92c-f5d1-4e08-a201-05c2f66a6979 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Calling method '>' {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:56.969097 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.compute.api [None req-f1a4f92c-f5d1-4e08-a201-05c2f66a6979 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] [instance: 870a289a-9e2c-4471-ac02-f9aa77461aff] Fetching instance by UUID {{(pid=127178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:56.976501 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f1a4f92c-f5d1-4e08-a201-05c2f66a6979 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:56.976986 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f1a4f92c-f5d1-4e08-a201-05c2f66a6979 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:56.977423 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f1a4f92c-f5d1-4e08-a201-05c2f66a6979 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:56.978120 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f1a4f92c-f5d1-4e08-a201-05c2f66a6979 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Acquiring lock "9109a614-d982-4086-8e90-ca50e4acd6aa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:56.978598 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f1a4f92c-f5d1-4e08-a201-05c2f66a6979 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:56.979022 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG oslo_concurrency.lockutils [None req-f1a4f92c-f5d1-4e08-a201-05c2f66a6979 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Lock "9109a614-d982-4086-8e90-ca50e4acd6aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:56.993577 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.wsgi [None req-f1a4f92c-f5d1-4e08-a201-05c2f66a6979 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] HTTP exception thrown: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f1a4f92c-f5d1-4e08-a201-05c2f66a6979 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Request method failure captured: Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: request: GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff HTTP/1.1 Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept: application/json Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Accept-Encoding: identity Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Connection: close Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Length: 0 Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Content-Type: application/json Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Host: 10.222.0.18 Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: Openstack-System-Scope: None Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Auth-Token: gAAAAABjEODFnwPNfevD_s2iqgjrJrwl5tsyQLcUPwsFoLuOLaCBQxUF3Innp8Fna8O4TdSVd9vYWEGFlMlL0SYz-lEDdpM7EPUs1IhWx7AcC2L6kveO3EqsUOvxYoQnZ0Lnpw-Lp1qby82G6PYCqAS-tNEfIiz9X92KchUl7n5MX3Dah7x9N0Y Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Id: None Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Domain-Name: None Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Identity-Status: Confirmed Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Is-Admin-Project: True Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Id: default Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Domain-Name: Default Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Project-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Role: reader,member Sep 01 16:45:56.995072 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Roles: reader,member Sep 01 16:45:56.996701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b9aa20e1ffb453d9ee13dd6ae2c25ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Sep 01 16:45:56.996701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:56.996701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Id: 9b9aa20e1ffb453d9ee13dd6ae2c25ef Sep 01 16:45:56.996701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1003831475 Sep 01 16:45:56.996701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:56.996701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Id: default Sep 01 16:45:56.996701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Domain-Name: Default Sep 01 16:45:56.996701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Id: a237b400429f4200909581e3c5e0cbfb Sep 01 16:45:56.996701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: X-User-Name: tempest-AttachVolumeNegativeTest-1003831475-project Sep 01 16:45:56.996701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: method: > Sep 01 16:45:56.996701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: exception: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. Sep 01 16:45:56.996701 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: action_args: {'id': '870a289a-9e2c-4471-ac02-f9aa77461aff'} Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: {{(pid=127178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:56.997612 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. Sep 01 16:45:56.999793 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.002097 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: DEBUG nova.api.openstack.wsgi [None req-f1a4f92c-f5d1-4e08-a201-05c2f66a6979 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] Returning 404 to user: Instance 870a289a-9e2c-4471-ac02-f9aa77461aff could not be found. {{(pid=127178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:57.002097 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: INFO nova.api.openstack.requestlog [None req-f1a4f92c-f5d1-4e08-a201-05c2f66a6979 tempest-AttachVolumeNegativeTest-1003831475 tempest-AttachVolumeNegativeTest-1003831475-project] 10.222.0.18 "GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff" status: 404 len: 111 microversion: 2.1 time: 0.031947 Sep 01 16:45:57.002097 dv-cinder-852209-10-iscsi devstack@n-api.service[127178]: [pid: 127178|app: 0|req: 565/1163] 10.222.0.18 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:56 2022] GET /compute/v2.1/servers/870a289a-9e2c-4471-ac02-f9aa77461aff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0)